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FOREWORD 



A project of this scope and complexity is truly a team effort. 
The mobility of university personnel poses problems for an effort 
which extends over as many years as this one. Similarly, other 
professional responsibilities compete for attention and time. Un- 
fortunately, Dr. Daniel Norton, who served as assistant director 
in designing the study, was forced to shift from a direct role to 
a consultative role because he left the university before the pro- 
ject was funded. Practical considerations required some modifica- 
tion of the original design. Professor Howard Rogers, a member of 
the Institute for Research in Human Behavior, assumed responsibility 
for part of the statistical analysis although he did not have the 
advantage of sharing in the original design and trial runs. Staff 
changes were also made among the field supervisors due to change in 
positions . 

Valuable suggestions were made by Professors B. Othanel Smith, 
Harold Mitzel, Donald Medley, and Winslow R. Hatch and by Dr. 

Abraham Barnett, who also provided assistance in the interpretation 
of the factor analysis. 

Particular appreciation is due Milton Firestone and the ISU 
Computer Center for many extra hours of work and computer time, to 
the ISU Audio-Visual Center for assistance in graphic presentation, 
to Jane Angel 1 for editing, and to Carolyn Gurman for assistance 
in editing and for typing. 

The staff is indebted to the many individuals in the public 
schools of Indiana and the more than two thousand student teachers 
who have at one time or another contributed to this project. 

While the Director assumes responsibility for the final report 
the entire team must receive the credit for sharing in the identi- 
fication of the problem, designing the instruments, and collecting 
and interpreting data. Howard Rogers was responsible for Chapter 
III and assisted with statistical analysis and interpretation. 
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SUMMARY 



This investigation was concerned with developing and testing two 
instruments and their accompanying manuals for evaluating and report- 
ing student teacher classroom behavior. 

The "Secondary Student Teacher Performance Profile" consisted of 
the following bi-polar criteria suggested by contemporary research and 
educational thinking as being related to teaching success: I. Under- 

standing, Friendly vs. Egocentric, Aloof; II. Planned, Organized, Re- 
sponsible vs. Unplanned, Disorganized, Irresponsible; III. Stimulating, 
Imaginative, Surgent vs. Dull, Routine, Unimaginative; IV. Perceives 
Self as Competent vs. Perceives Self as Less Than Adequate; V. Has 
Mastery of Facts & Organizing Principles of Field vs. Has Only Minimum 
Knowledge of Field; VI. Communicates Well & Empathetically vs. Communi- 
cates Ineffectively & Perfunctorily; VII. Classroom Discourse Charac- 
terized by Reasoning or Creative Thinking vs. Classroom Discourse 
Characterized by Simple Recall; VIII. Directs Attention to Process of 
Thinking vs. Fails to Call Attention to Process of Thinking; IX. High 
Professional Potential vs. Low Professional Potential. 

The "Teacher Classroom Activity Profile" provided the following 
seven categories of activity among which the student teacher's time 
was distributed: MN- -Management-Non-Learning ; ML- -Management-Learning; 
P--Presentation; R--Recitat ion; D~ -Discussion/Random; LT--Logical 
Thinking; and TP- -Thinking Process. 

Student teachers were evaluated on the Secondary Student Teaching 
Performance Profile criteria under five experimental "treatments" to 
determine the reliability of the ratings. The intra-observer reliabil- 
ities were low. The intra-observer treatments revealed some differ- 
ences but none of them produced a high level of reliability. The 
inter-observer reliabilities with five observers on a team approached 
an acceptable level. Where a special training procedure was used the 
reliabilities were high. 

Some relationships were found between criterion ratings and grade 
point averages, estimated grade point averages, and supervising teachers' 
ratings. No correlations were found between criterion ratings and 
scores on the Scholastic Aptitude Test, and the Cornell Critical Think- 
ing Test. Some scores on the 16 Personality Factor Questionnaire were 
found to be statistically, significantly different from zero. They 
were so low as to have little predictive value; however, they do sug- 
gest that further study might be fruitful. 

As a result of cooperative study and in-service training, the staff 
members felt that they were able to make judgments of sufficient re- 
liability as to be helpful in modifying the student teacher's professional 
education and influencing his job placement. Criteria VII and VIII con- 
cerned with reasoning and thinking proved the most difficult, but at the 



ERIC 



9 



same time continued to present a challenge. The fact that only ten 
percent of classroom time was devoted, to reasoning and higher level 
intellectual activities suggested the need for curriculum revision 
in the secondary schools and in the teacher preparatory institutions. 

While further refinements of the techniques are necessary there 
is no evidence that evaluative instruments and techniques used in 
this study are any less reliable than current practices of credit 
counting, giving grades and making generalized evaluations. 

The Secondary Student Teacher Performance Profile and the 
Teacher Classroom Activity Profile give promise of being effective 
aids in the supervision and evaluation of student teachers. 



CHAPTER I 



INTRODUCTION 



The Problem 

This study was an attempt to determine the extent to which it is 
possible to evaluate the performance of selected secondary student teachers 
on criteria drawn from contemporary research on teacher behavior in the 
typical student teaching classroom and, further, to discover how such eval- 
uations relate to other data descriptive of the student teacher. 



The Setting 



The Program 

Secondary Student Teaching at Indiana State University is a full-time, 
off-campus, eight-week experience. One half of the professional semester, 
which occurs during the student's senior year, is spent in the field and 
the other half on campus. Platoon I students are in the field the first 
eight weeks of the year and on campus the second eight weeks. Platoon II 
students are on campus the first eight weeks and in the field the second. 
Similar arrangements are made for Platoons III and IV during the second 
semester . 

Prerequisites to the professional semester are General Psychology, 
Psychology of Childhood and Adolescence, and Teaching and Learning in the 
Secondary School. Some students take the methods course in their subject 
field before the professional semester. During one-half of the profes- 
sional semester students enroll in supervised teaching for six hours of 
credit, one of which covers the orientation and evaluation seminars. The 
other half -semester he enrolls in campus courses- -Educational Technology 
(1 hour credit). Problems in Secondary Teaching (2 hours). Foundations of 
Secondary Education (2 hours), and a methods course in the subject field. 

In the regular program at Indiana State University student teachers 
are visited at least three times by the college representative. The 
first visit is made early in the assignment before students are actively 
engaged in teaching, and is primarily concerned with administrative mat- 
ters and personal adjustment to the situation. On the second and third 
visits the supervisor observes the student as he teaches. 

The Staff 

Administration and supervision of the student teaching is provided 
by full-time staff members of the Division of Teaching and shared by 
Departmental Supervisors who teach the special methods courses. At the 
present time the Division of Teaching consists of eleven full-time staff 
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members and twenty-one part-time Departmental Supervisors. All members 
of the Division of Teaching staff have academic rank--one Instructor, 
four Assistant Professors, three Associate Professors, and three Pro- 
fessors. During the academic year they devote their full time to stu- 
dent teaching, each working with 17 to 20 students each of the four 
platoons, in one section of the state of Indiana. Staff meetings are 
held each Monday on campus. The staff is also on campus for the ori- 
entation seminars, application conferences, and evaluation week. During 
the summer term most members of the staff teach education courses. 

Departmental Supervisors, who are members of the subject-matter 
departments, teach the special methods courses, work with the Division 
of Teaching staff in placing student teachers, and actually supervise 
their students who are assigned in the local community. Approximately 
one-fifth of the student teachers are supervised by Departmental Super- 
visors who are specialists in the subject field and four-fifths are 
supervised by the Division of Teaching staff who are generalists or, 
rather, specialists in Pedagogy. 

The members of the Division of Teaching staff participated in all 
phases of this study. The Departmental Supervisors participated only 
in the phase concerned with the analysis of classroom activity, reported 
in Chapter V. 



The Student Population 

All student teachers involved in this project were randomly se- 
lected. Tables 1.1 and 1.2 provide selected data on these students and 
on other members of the senior class for the two years 1966-1967 and 
1967-1968. 

As shown in Table 1.1, the population involved in the study had a 
slightly higher proportion of females than that of the senior class. 

The grade-point percentiles for the study group were slightly higher 
than those of male seniors and slightly lower than those of female seniors. 
The differences with respect to sex and grade-point average between the 
student teachers involved in the study and other members of the senior 
class were relatively slight. 

Although no attempt was made to provide proportionate representa- 
tion by subject-teaching-field. Table 1.2 shows that no serious im- 
balance occurred with respect to subject fields. Approximately fifty 
percent of the student teachers enrolled each semester were included 
in the study. 
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Data supplied by Indiana State University Office of Institutional Research and 
Testing. GPA mean scores were not available for all seniors. 



TABLE 1.2 



DISTRIBUTION OF SECONDARY STUDENT TEACHERS AND STUDENTS IN THE STUDY GROUP 
INDIANA STATE UNIVERSITY 1966-1968 BY SUBJECT FIELDS 





Students not 


in Study 


Students in Study 


Department 


Supervised by 
Department 


Supervised by 
Division of 
Teaching 


Supervised by 
Division of 
Teaching 


Total 


Art 


10 


13 


16 


39 


Bus iness 


15 


13 


49 


77 


English 


52 


16 


78 


146 


For. Lang. 


15 


8 


37 


60 


Home Ec. 


13 


7 


34 


54 


Ind . Ed . 


59 


44 


53 


156 


Math 


29 


13 


40 


82 


Music 


8 


30 


42 


80 


Phys. Ed. 


56 


43 


80 


179 


Science 


28 


10 


35 


73 


Soc. St. 


71 


20 


72 


163 


Sp. Ed. 


40 


26 


28 


94 


Totals 


396 


243 


' 564 

t 

it 


1203 
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The Observational Patterns 



Four patterns of observing student teacher performance were planned 
in the experimental design. These patterns, which will be called Treat- 
ments, were as follows: 

Treatment Is A member of the Division of Teaching staff 
observed a student teacher for a full class period during 
the third or fourth week of the student's field experience 
and again during the seventh or eighth week. This pattern 
was similar to the regular university student teaching pro- 
gram and constituted a quasi-control group. 

Treatment 2: A staff member observed a student teacher 

four times- -once each in the second, fourth, sixth, and 
eighth weeks . 

Treatment 3: A team of two staff members observed a student 

in a single class during the fifth or sixth week. 

Treatment 4: A staff member observed a student in two dif- 

ferent classes on the same day. 

Treatment 5: A replication of Treatment 3 during the sum- 

mer of 1968. 



The Instruments 

The basic instrument. Secondary Student Teacher Performance Profile 
(SSTPP) , consists of nine bi-polar criteria on which the observer rates 
the student's performance on a seven-point scale. A copy follows. 

Secondary Student Teacher Performance Profile 
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T ”2 " 

STIMULATING. IMAGINATIVE , SURGENT 
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1 2 1 3" 
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VS 



l 



I 



! 3ZX 



COMMUNICATES WELL * EMPATHETIC ALLY 



VS 
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COMMENTS : 



OBSERVER: 



I | EGOCENTRIC, ALOOF N 

5 1 6 j 7 

1 UNPLANNED. DISORGANI ZEO. IRRESPONSIBLE N 
— 1 6 T 7 
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~~§ I © j 7 
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5 1 6 1 7 

I HAS ONLY MINIMUM KNOWLEDGE OF FIELO N 
1 © 1 7 

COMMUNICATES INEFFECTIVELY * PERFUNCTORILY N 

5 6 I 7 
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A supplementary instrument. Teacher Classroom Activity Profile 
(TCAP) , is an instrument for recording the way the teacher spends his 
time in the classroom. Seven discrete categories of behavior are iden- 
tified. The observer records a continuous line from the beginning until 
the end of the observational period using one minute intervals. A copy 
follows. 
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Teacher Classroom Activity Profile 



TEACHER CLASSROOM ACTIVITY PROFILE - I.S.U. DIVISION OF TEACHING 






TEACHER ACTIVITY 


3 MINUTE INTERVALS 
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DATE. 
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Treatment of Data 

The data were first analyzed to ascertain the effects of different 
observational patterns on reliability. Second, a factor analysis was 
employed to determine the extent to which common elements were present 
over the nine criteria. Finally, the ratings on the nine criteria were 
examined to determine if they were related to the following data, grade- 
point average, estimated grade-point average, estimates made from an 
interview, evaluative reports by cooperating teacher, SAT score, score 
dn the Cornell Critical Thinking Test, scores on the 16 Personality Factor 
Questionnaire, and time distribution on TCAP. 

Schedule 

The study covers a five-year period. Beginning in 1964, two years 
were spent studying the research, agreeing upon evaluative criteria, de- 
signing the instruments, training observers, and running a pilot study. 

The next two years were devoted to collecting data. The final year was 
spent in analyzing the data and writing the report. 
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CHAPTER II 



BACKGROUND 



While this project has its roots in the cumulative experiences 
of all those who participated in it, it is directly related to an 
earlier attempt to improve the evaluation of 'Student teachers, which 
was abandoned. In 1950 the following items were added to the Indiana 
State College Student Teacher Evaluation Form: "Comment on the stu- 
dent's professional philosophy, attitudes, and understandings: Does 

he understand the crucial role schools play in maintaining and extend- 
ing the democratic way of life? Does he try to develop those values, 
habits and skills necessary for our democratic society? Does he use 
the scientific method?" Those who completed the form resisted respond- 
ing to these items so vigorously that the items were revised to read: 
"Co mm ents on the Student's Understanding, Attitudes, Philosophy, etc. 

No one denied the relevance of the questions but almost everyone felt 
inadequate to the challenge of answering. In a real sense this project 
is a second attempt to improve the evaluation of student teacher per- 
formance by developing some new instruments and procedures. 

Although previous attempts to quantify and appraise teacher effec- 
tiveness have been only partially successful, the scientific upgrading 
of education requires nothing less. 

The rational development of a professional program for teacher 
preparation requires that professional competencies be identified and 
ways of assessing the degree of competence be developed. Conant sug- 
gests that the student teacher's performance in the classroom should 
be the chief factor in granting him a certificate to teach. Hopefully, 
teacher certification could come to be based on professional competence 
rather than on tabulation of the number of courses taken. 1 

The professional role of the college supervisor in visiting a stu- 
dent teacher's classroom has not been adequately described. Too often 
he concentrates his attention on the psychological state of the student 
rather than on his actual teaching performance. Too much supervisory 
attention is devoted to praise or criticism and too little to analysis 
and interpretation. 



lj. B. Conant, The Education of_ American Teachers (New York: 
McGraw-Hill, 1963). 



Current practices in the evaluation of student teaching reflect 
the uncertainty about purposes and methods of teacher preparation 
which has characterized the profession for the past half century. 

Most instruments for evaluating student teaching concentrate on gen- 
eralized qualities of personality and almost ignore pedagogical com- 
petence. Recent attempts to define the act of teaching and recent 
research on teaching skills and teacher competencies suggest the pos- 
sibility of determining criteria upon which a teacher's performance 
can be evaluated. The student teaching experience provides an oppor- 
tunity to apply the evaluative criteria during the student's pre- 
service education. 

The staff hoped to develop instruments and techniques for evalua- 
ting student teacher performance which could be used in a typical 
student teaching situation. At the same time it was proposed to study 
experimentally the relationships which obtain among the criteria when 
they are employed in a variety of observational situations and se- 
quences to establish the reliability and operational utility of ratings 
so made by college supervisors. 

Research on teacher behavior suggests that certain criteria on an 
acturial basis are related to teaching success. This study attempted 
tc apply such criteria in actual classroom situations to individual 
student teachers. 

Most research dealing with teacher classroom behavior involves 
such complex instrumentation and requires such detailed recording, 
coding, and analysis that only full-time researchers or specialists 
in observation can conduct it. The staff hoped to develop a technique 
which could be employed by specially trained college supervisors as 
they worked in a student teaching program. Research and curriculum 
improvement were to be "double yoked." 



Rationale 

This study rested upon four implicit assumptions. 

First, since teaching is behavior, it can be analyzed and changed. 

It was recognized that teaching behavior is complex and difficult to 
analyze but it must be so analyzed if teaching behavior is to be improved. 

Second, a study of the behavior of teachers should include a focus 
upon intellectual operations as a necessary supplement to the many re- 
cent research projects which focus primarily upon classroom climate and 
interaction. While teaching is interaction between teacher and pupil, 
this study will be concerned primarily with the teacher's behavior and 
only incidentally with the pupils' reactions. 

Third, relationships between effective teaching and certain char- 
acteristics and behaviors which have been identified on an actuarial 
basis could be applied on a clinical or individual basis. 



Fourth, evaluation of teacher classroom behavior can be made by 
trained observers without employing the time-consuming collecting, 
coding, and analyzing of detailed protocol material by full-time re- 
searchers . 

It was recognized that each of the assumptions posed problems 
and presented both theoretical and practical difficulties. The staff 
recognized that participation in such a project would likely result 
in improved supervisory practice and curriculum reorganization. They 
recognized that "very little is known for certain about the nature and 
measurement of personality, or about the relation between teacher per- 
sonality and teaching effectiveness ," 2 but they saw much merit in pur- 
suing some of the implications of recent research. The importance of 
the emotional climate in the classroom was not minimized but the staff 
felt that the intellectual aspects of teacher behavior were of greater 
significance. They felt, in the words of John Fischer, that before 
teaching can attain full professional status it will be "necessary first 
to specify the knowledge and skill that distinguish a professional 
teacher from other well-intentioned people who get along with students." 

The problem was to eclectically identify criteria for evaluating 
teacher behavior as reported in recent research and then develop a 
technique for using these criteria in assessing student teacher be- 
havior . 

The nine criteria agreed upon for this study were assumed to be 
valid on the basis of prior research and/or expert opinion. No attempt 
was made to evaluate the effect the teacher had upon pupil learning. 

In summary, the premises of this study were that a highly trained 
college supervisor can (a) improve his helpfulness to the student 
teacher, (b) provide more accurate prognostic assessments, and (c) 
give better direction to the institution in its program development 
if he employs criteria which are drawn from research and which are 
behavioral ly defined rather than if he uses the vague, non-specific, 
and poorly-defined criteria which are usually employed in student 
teaching evaluation. 



2 N. L. Gage (ed.), Handbook of Research on Teaching (American 
Educational Research Association, Chicago: Rand McNally, 1963), p.574. 

^John H. Fischer, review of Turmo i 1 in Teaching by T. M. Stinnett, 
Phi Delta Kappan , Vol. 50, No. 2 (October, 1968), p. 119. 
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Defining "Teaching" 



In the absence of an agreed-upon theory of teaching, the staff ac- 
cepted the paradigm developed by B. 0, Smith which describes the teaching 
cycle as the sequential process of interacting between teacher and learner 
which consists of the teacher's perceiving, diagnosing, and reacting to 
the pupil who in turn perceives, diagnoses, and reacts to the teacher. 



p t -» D t-» R t-* p P -> D P -^ V* p t~* D t-> etc - 



Where P = Perceiving, 
Subscripts t = teacher 



D = Diagnosing, 
, p - pupil 4 



R = Reacting and the 



It is obvious that such a paradigm rejects the concept of teaching 
as merely the imparting of knowledge or the mastery of a particular method. 
This paradigm suggests that special preparation to teach is necessary in 
order to help the teacher perceive and diagnose accurately and make the 
most promising reaction. It recognizes the complexity of the teaching act 
and the infinite varieties of styles and strategies which can be employed, 
but focuses upon meaningful, finite agglomerates. 

The staff in surveying research on teaching was well aware that 
little is known for certain about the nature and measurement of teacher 
personality and teaching effectiveness. However, research and expert 
opinion suggested the nine criteria which they were content to apply to 
teacher performance in the classroom. 



Defining "Thinking" 

While examining the intellectual aspects of teacher behavior con- 
stituted the chief raison d'etre it also posed the most serious problems. 
The problem of defining thinking in behavioral terms has not yet been 
solved. In common use thinking has meant anything that goes on in the 
head from day-dreaming to designing a formula for inter-stellar travel. 

It was necessary to develop a functional concept of thinking in the 
classroom. 

This section attempts to share some of the concepts related to 
thinking as the staff agreed upon a vocabulary and a rubric necessary 
for effective communication. This is not presumed to be a definitive 
analysis of thinking. 

George Bernard Shaw is reported to have said that there are thousands 
of ways to write a poem and every one of them is right. Similarly, there 
are hundreds of ways of thinking about thinking and every one of them has 
its justification. It is pointless to argue the merits of one system of 
categorizing thinking over another system; however, it was necessary to 
agree upon the categories and terms to be used in this project. 



B. 0. Smith, "A Concept of Teaching," Chapter Six, Language and 
Concepts in Education by B. 0. Smith and R. H. Ennis (Chicago: Rand 
McNally, 1961). 
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Webster 1 s Unabridged Dictionary includes the following definitions 
of the verb "to think": (1) to form or have in the mind; conceive: (2) to 

hold in one's opinion; judge; consider: (3) to believe; surmise; expect: 

(4) to determine, resolve, work out, etc. by reasoning: (5) to have an 

intent; purpose; intend: .... 

While the development of thinking has always been accepted as an im- 
portant educational objective, its implementation in classrooms has been 
haphazard. An examination of curricula and classroom practices leads to 
the conclusion that thinking is frequently only a by-product of studying 
certain subjects or accumulating information. Little attention has been 
paid to helping the teacher learn to assist students in improving their 
thinking. The examination of the literature in the field revealed no 
adequate definitions or models for dealing with thinking but did provide 
help in developing a workable system. 

A very simple system of categorization which is widely used identi- 
fies two types of thinking as (1) inductive or (2) deductive. Recently 
Gallagher and others emphasize convergent vs. divergent thinking. 

The Scientific Method, or the Method of Inquiry, is used to describe 
the processes of (1) formulating an hypothesis, (2) collecting data, 

(3) checking the hypothesis against the data, and (4) drawing a conclusion. 

A similar system is commonly referred to as Problem Solving and 
usually refers to the processes involved in (1) identifying a problem, 

(2) hypothesizing a solution, (3) collecting data, (4) checking the data 
against the hypothesis--revising the hypothesis in light of the implica- 
tions of the data, and (5) applying the results to the solution of the 
problem. These are closely related to Dewey's steps in the thinking pro- 
cess which have been identified as (1) sensing a problem, (2) identifica- 
tion of the nature of the problem, (3) searching for possible solutions, 

(4) analyzing the adequacy of tentative solutions, and (5) testing the 
most promising of the solutions by action. 

The Progressive Education Association's Eight-Year Study focused 
on the development of critical thinking. Three objectives of thinking 
were identified: (1) the ability to infer generalizations from specific 

data, (2) the ability to apply known principles in explaining new situa- 
tions or predicting consequences, and (3) the ability to do critical 
thinking per se.^ 



^ E. R. Smith and R. W. Tyler, Appraising and Recording Student 
Progress (New York: Harper, 1942). 
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B. 0. Smith in A Study of the Logic of Teaching identified the fol- 
lowing twelve categories of logical operations in teaching: (1) Defining, 

(2) Describing, (3) Designating, (4) Stating, (5) Reporting, (6) Substi- 
tuting, (7) Evaluating, (8) Opining, (9) Classifying, (10) Comparing and 
Contrasting, (11) Conditional Inferring, and (12) Explaining. He further 
subdivided Categories 1, 3, and 12 and recognized that some attention is 
devoted to managing the classroom.^ 



John C. Wilson suggested that prose statements can be classified into 
the following types: (1) Imperatives and Attitude Statements, (2) Empiri- 

cal Statements, (3) Analytical Statements, (4) Value Statements, and (5) 
Metaphysical Statements.' 



Bloom, in his work in developing a system for classifying educational 
objectives, identified the following categories within the cognitive do- 
main: (1) Memory (Knowledge), (2) Translation, (3) Interpretation, (4) 

Application, (5) Analysis, (6) Synthesis, (7) Evaluation. 

Mary Jane Aschner suggested that one way to approach the problem of 
logic and language in the classroom would be to classify the thinking 
under the following rubric: (1) Remembering, (2) Reasoning, (3) Evalu- 

ating or Judging, and (4) Creative Thinking. 



Donald Medley classified teacher statements in coding behavior with 
OScAR 4V into six major categories with three areas: (1) Affective State 

ments, (1.1) Considering, or (1.2) Rebuking; (2) Substantive Statements, 
(2.1) Informing, or (2.2) Problem Structuring; and (3) Procedural State- 
ments, (3.1) Directing, or (3.2) Describing. 10 



6 

B. 0. Smith, Mary Jane Aschner, and Milton Meux, A Study of the 
Logic of Teaching*, A report of the first phase of a five years' research 
project. The Logical Structure of Teaching and the Development of Criti- 
cal Thinking, Project #258 (7257), U.S. Office of Education (Urbana, 111. 
Bureau of Educational Research, College of Education, University of 
Illinois). (Dittoed.) 

^ John Wilson, Language and the Pursuit of Truth (Cambridge, 

England: University of Cambridge Press, 1960). 

8 

Benjamin Bloom (ed.). Taxonomy of E ducational Objectives (New 
York: Longmans, Green, 1958). 

^Mary Jane Aschner, "The Language of Teaching," Teachers College 
Record , Vol. 61 (February, 1960), pp. 251-52. 

■^Donald M. Medley, "Coding Behavior with OScAR 4V," pre -publication 
draft (Princeton, N.J.: Educational Testing Service). (Mimeographed.) 
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Louis E. Raths and his colleagues suggested the following types of 
thinking operations: (1) Comparing, (2) Summarizing, (3) Observing, 

(4) Classifying, (5) Interpreting, (6) Criticizing, (7) Looking for 
Assumptions, (8) Imagining, (9) Collecting and Organizing Data, (10) 
Hypothesizing, (11) Applying Facts and Principles, (12) Decision- 
Making, and (13) Designing Projects or Investigation'. 

Gallagher, Aschner, and Jenne^ based their classification upon 
Guilford* s 13 model of intellectual performance to arrive at (1) Cogni- 
tive Memory, (2) Convergent Thinking, (3) Divergent Thinking, and (4) 
Evaluative Thinking. To these four they added (5) Routine. 

Woodruff developed a schema showing the relationships between 
mental processes in learning and their related processes in teaching. 
Mental processes are classified as (1) Level A--Perception, Stimula- 
tion; (2) Level B--Inductive ; (3) Level C — Inductive Tryout; and (4) 
Level D--Deductive — Analysis and Creation. The corresponding processes 
of teaching are: (1) Level A — Show; (2) Level B--Discuss; (3) Level C-- 

Apply; and (4) Level D — Guide Original Thinking. 

The Ford Foundation experimental intern program at Stanford Uni- 
versity studied the problem of identifying criteria for appraising 
intern trainees. 15 Unfortunately their work did not come to the atten- 
tion of the Indiana State University staff until too late to influence 
the design or operation of this study. 



^Louis E. Raths, Selma Wassermann, Arthur Jonas, and Arnold M. 
Rothstein, Teaching for Thinking - - Theory and Application (Columbus, 
Ohio: Charles E. Merrill Books, Inc., 1967). 

12 

James J. Gallagher, Mary Jane Aschner, and William Jenne, 
Productive Thinking of Gifted Children in Classroom Interaction , 

CEC Research Monograph Series B., No. B-5 (Washington, D.C.: The 

Council for Exceptional Children, NEA, 1967). 

13 

J. P. Guilford, "Three Faces of Intellect," American Psycholo - 
gist , Vol. 14 (1959), pp. 469-79. 

^Asahel D. Woodruff, Basic Concepts of Teaching (San Francisco: 
Chandler, 1961), pp. 126-27. 

15 

Robert N. Bush, Norman J. Boyan, and Dwight W. Allen, Stanford 
University School of Education Secondary Teacher Education Program . 
1965-1966. Resident Supervisors Handbook (Palo Alto). (Offset.) 
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The Stanford Teacher Competence Appraisal Guide 1964-65 rated in- 
terns on a seven-point scale with respect to thirteen teacher roles 
clustered under four major headings: Aims--Clarity of Aims, Appro- 

priateness of Aims; Planning- -Organization of the Lesson, Selection 
of Content, Selection of Materials; Performance--Beginning the Lesson, 
Clarity of Presentation, Pacing of the Lesson, Pupil Participation and 
Attention, Ending the Lesson, Teacher-Pupil Rapport; Evaluation--Variety 
of Evaluative Procedures, Use of Evaluation to Improve Teaching and 
Learning . 

While both the Stanford program and the Indiana State University 
program appear to have grown out of similar rationales and to use a 
similar approach, they differ markedly in the criteria selected and 
the instruments developed. The Stanford Teacher Competence Appraisal 
Guide as contrasted with the Indiana State University Secondary Stu- 
dent Teacher Performance Profile calls for judgments on thirteen ele- 
ments as contrasted with nine. The Stanford approach breaks down 
teacher behavior into more specific actions. The Indiana State Uni- 
versity SSTPP form is restricted to evaluating the student on the basis 
of what he does in the classroom whereas the Stanford Guide includes 
ratings of aims and planning. It is possible that the interest at 
Stanford in identifying the micro-aspects of teaching shaped the struc- 
turing of the Guide. The criteria appear to be related to the Stanford 
conception of the various discrete roles a teacher plays. The Indiana 
State criteria, by contrast, grew out of the staff's perceptions of 
the kinds of behavior research has suggested are related to teaching 
success . 

Hilda Taba presented an excellent analysis of the problems in- 
herent in studying the thinking process and teaching strategies . *6 
Unfortunately, her study was not available to the staff until most 
of the work had been completed. 

In the absence of any commonly agreed upon system for organizing 
ideas about intellectual activity the staff developed its own. The 
Indiana State University system recognized that a great variety of in- 
tellectual activities are involved in teaching and that it would be 
necessary to develop some operational definitions which would permit 
communication among all concerned. No claim for its superiority over 
other systems is made. It is not presented as a definitive taxonomy 
of the thinking process. 

Wittgenstein's view that "the meaning of a word is its use in 
the language " ^ was accepted. 



16 H. Taba, S. Levine, and F. F. Elzey, Thinking in Elementary SchooJ. 
Children . USOE Cooperative Research Project No. 1574 (San Francisco 
State College, 1964). 

Ludwig Wittgenstein, Philosophical Investigations (Oxford: Basil 

Blackwell, 1958), p. 232. 
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The model which evolved from the staff study identified four 
levels of intellectual activity which could be categorized from ob 
servations of teacher behavior. 



Levels of Intellectual Teacher Activity 

Activity 



Level One: 

Managing 



Directing, Commanding, Managing, 
Rebuking, Accepting Students. 

These are usually imperative 
statements . 



Level Two: 

Informing 



Presenting Information, Reporting, 
Describing, Recalling from Memory. 
Getting students to do these. 

These are usually empirical 
statements . 



Level Three: 
Thinking 



Summarizing, Classifying, Explaining, 
Reasoning and Evaluating. Getting 
students to do these. 

These are usually relational state- 
ments . 



Level Four: Thinking about Thinking; Analyzing 

Thinking Process the Processes of Thinking Going on 

in Others; Recognizing the Roles 
Played by Assumptions, Biases, and 
Values; Locating Sources of Misun- 
derstanding. Getting students to 
do these. 

These are usually logical statements. 



This analysis of thinking proved helpful in identifying the various 
categories for classifying student teacher behavior on the Teacher Class- 
room Activity Profile. It also provided the basis of making evaluative 
ratings on Criteria VII and VIII of the Secondary Student Teacher Perform- 
ance Profile. 

The schema which follows suggests relationships between this sys- 
tem for looking at the teacher's intellectual activities and the staff's 
interpretation of the way some other scholars have organized their think- 
ing. The relationships are approximations and tangential. The purpose 
of showing them here is to give added meaning to this system of classi- 
fication rather than to compare one with another. 





RELATIONSHIPS BETWEEN THE SCHEMA DESIGNED FOR THIS STUDY AND THOSE DEVELOPED 
BY OTHERS FOR ORGANIZING IDEAS ABOUT THINKING AND THE TEACHING ROLE 
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Level Four: Analytical Statements Looking for 

Thinking Assumptions 



RELATIONSHIPS BETWEEN THE SCHEMA DESIGNED FOR THIS STUDY AND THOSE DEVELOPED 
BY OTHERS FOR ORGANIZING IDEAS ABOUT THINKING AND THE TEACHING ROLE 

(Continued) 
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Level Four: Evaluation Some Aspects of 

Thinking Guiding Original 

Process Thinking 



Developing the Instruments 



The basic instruments, "A Guide for Assessment of Secondary Student 
Teacher Performance (Tentative)"* and the "Secondary Student Teacher 
Performance Profile" (SSTPP) were cooperatively developed by the staff 
as an outgrowth of a study begun in 1963. 



The staff studied the literature and research on teacher competence 
and teacher behavior in the classroom. Three of the researchers. Smith, 
Mitzel, and Flanders, visited the campus and consulted with the staff. 
During fortnightly staff meetings the techniques for reporting judgments 
and the procedures for making observations were agreed upon. During the 
spring semester of 1964 and both semesters of 1964-65 the staff used the 
instrument on its regular supervising visits. Changes were made in Cri- 
teria IV and VIII and the Guide was refined and amplified. Further ad- 
ditions and modifications were made on the Guide during the project. 

The Guide describes the instrument. Secondary Student Teacher Per- 
formance Profile (SSTPP), and how it is to be used by college super- 
visors in reporting observations of student teachers. It identifies 
the theoretical and research foundations for each of the nine criteria 
of the SSTPP. It provides operational definitions of terms by giving 
examples of behavior which serve as clues for rating student teachers' 
performance on the various dimensions and criteria of SSTPP. It de- 
scribes the procedures to be followed in making observations. 

The Secondary Student Teacher Performance Profile provides nine 
criteria upon which the supervisor will rate the student on a seven- 
point continuum. The classroom behavior of teachers provides the organ- 
izing principle for this instrument. The nine criteria were drawn from 
various research studies which had been designed with differing logical 
premises. The criteria, therefore, are eclectically rather than logi- 
cally derived. 

A second instrument. The Teacher Classroom Activity Profile (TGAP), 
together with a guide for its use and a glossary of terms, was coopera- 
tively developed by the staff to provide a means for recording the ways 
in which the teacher spends classroom time.** 



* A copy of the Guide is included as Appendix A. 

** The development of TCAP is further explained in Chapter IV. 

A copy of the instrument, the guide, and glossary of terms appear as 
Appendix B. 



Review of Research 



Research related to this study falls into two classes. The first 
covers observation of teacher behavior; the second is concerned with 
criteria which might be employed during observation. These classes are 
not discrete. Some research has significance in both classifications. 

Research Related to Observing Teacher Behavior 

The work of B. Othanel Smith in developing the concept of teaching 
as "a system of actions intended to induce learning"^ and his study of 
the logic of teaching^ provided the initial stimulus for this study. 
Conant's report, which might more properly be called his proposals 
rather than research, suggesting that certification be based on a per- 
son's ability to teach, has highlighted the urgency of discovering a 
means whereby the teacher's ability to teach can be objectively deter- 
mined in the classroom. ^0 

Smith found that it was possible to classify teacher behavior in 
the classroom into three categories: Expressive Behavior, Performative 

Behavior, and Linguistic Behavior. He was also able to classify logi- 
cal operations that went on in the classroom by careful transcription 
of classroom discourse and subsequent classification of what he called 
"episodes." 

The work of the NEA Commission on Teacher Education and Profes- 
sional Standards as reported by Margaret Lindsey played an important 
role by identifying the problem of teacher professional competence and 
challenged the staff to embark on this project. 21 

Two publications were most influential in designing the procedures 
employed in this investigation. They are the chapter contributed by 
Medley and Mitzel^ to the Handbook of Research on Teaching and the re- 



18 

B. Othanel Smith and Robert H. Ennis, Language and Concepts in 
Education (Chicago: Rand McNally, 1961). 

■^Smith, Aschner, and Meux, o£. cit . 

20 

v Conant, op . cit . 

^ ^Margaret Lindsey, New Horizons for the Teaching Profession (Wash- 
inton, D.C.: National Commission on Teacher Education, NEA, 1961). 

^Donald m. Medley and H. E. Mitzel, "Measuring Classroom Behavior 
by Systematic Observation," Chapter 6, in N. L. Gage, ojd. cit. 
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port of an investigation conducted by Wilk and Edson. 23 in addition to 
serving as models for the performance of this invest igat ion , they pro 
vided technical guidance for performing the research which was proposed. 

Medley and Mitzel stated, "Certainly there is no more obvious ap- 
proach to research on teaching than direct observation of the behavior 
of teachers while they teach and pupils while they learn .... That 
observation'll data are difficult and expensive to obtain is a fact that 

cannot be denied." 

Writing in 1958 in the Journal of Experimental Education , they dis- 
cussed the relative merits of analysis of variance and correlation ana- 
lysis as techniques for estimating reliability coefficients and con- 
cluded that analysis of variance should be adopted as the preferred 
technique. This conclusion was restated and expanded in their handbook 
chapter. In the latter, it was suggested that mixed statistical models 
were appropriate for observational studies of teacher behavior and that 
observers' tasks should be kept as nearly objective as possible. The 
studies reviewed by Medley and Mitzel incorporated criteria employed 
through the 1950's. The broadly genera lizable model which they presented 
provided for analysis of variance with items as factors in the analysis. 

The investigation reported by Wilk and Edson included many details 
which are relevant to this investigation. The subjects were 36 elementary 
student teachers. They were observed by regular supervisors of student 
teaching and by specially trained observers. The OScAR III and the 
Minnesota System of Interaction Analysis were employed as student teacher 
behavior criterion measures. Pertinence of the study to this study may 
be recognized in a question which the investigation attempted to answer. 

It was : 

Using certain teaching behaviors as the basis for comparison, 
what is the relationship of ratings of student teachers by 
student teaching supervisors using their established ob- 
servational methods and the ratings made by research ob- 
servers using the methods designed for this study? 

The Wilk and Edson study did not employ a mixed model for analysis. 
However, their model was close to the mixed model in function. It seems 
likely that results of their analysis can provide direction for persons 
interested in research on observational problems in student teacher 
assessment. Among the conclusions arrived at from their analyses were 

the following: 

On the basis of the admissions interview and data available 
at the time of admission, counselors could not predict success- 
fully which students would exhibit integrative classroom be- 
havior as student teachers. 

The student teaching supervisor and research observers ... 
exhibited a high degree of general agreement when rating 



23 Roger E. Wilk and Killian H. Edson, A Study, of fte Rglatjion- 
ships Between Obs erved Classroom Behaviors of Elementar y S — _ — — 

Predictors of Those Behaviors , and Ratings by Supervisory (Minneapolis . 
College of Education, University of Minnesota, January, 1962). 
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either personality variables or judging classroom performance. 
However, there is little relationshi; .etween the scores as- 
signed to the need dominance factor. 

To the extent that there is lack of agreement between the 
ratings of supervisors and observers one may conclude that 
this is due to the unaccounted-for variance, i.e., error, 
but one may also interpret the data to suggest that the 
rater bias is an important factor in the deviations where , 

there is but one rater to judge a student's performance .... 

Medley and Mitzel in an early study supplemented classroom observa- 
tion with video tape recordings to obtain a more meaningful record of 
teacher performance and a measure of student teacher growth . ^ Their 
instrument (OScAR) and their techniques for reporting teacher behavior 
have been influential in designing this study, in building the Secondary 
Student Teacher Performance Profile (SSTPP), and in writing the Guide 
for Assessment of Secondary Student Teacher Performance (Tentative). 

Suggestions for organizing the behavior of teachers in the class- 
room were gained from Marie Hughes' classification of teaching into seven 
functions. 26 Her conclusion that teachers' behavior patterns are stable 
through time was viewed as an hypothesis to be examined. Her model pat- 
tern for teacher behavior which may be relevant for elementary schools 
may have limited implications for this study which is restricted to secon- 
dary classrooms. 

Flanders' work on interaction analysis suggests the need for care- 
ful training of observers. 27 

The one hundred research projects which constitute Ryans' study of 
teacher characteristics provided a wealth of suggestions for observing 

teacher performance. 28 

24 Ibid., pp. 72-76 

25 

H. E. Mitzel, A Behavioral Approach to the Assessment of Teacher 
Effectiveness (New York: Division of Teacher Education, College of the 

City of New York, 1957). (Mimeographed.) 

H. Schueler, M. J. Gold, and H. E. Mitzel, The Use of Television 
for Improving Teacher Tra ining and for Improving Measures of Student - 
Teaching Performance , Phase I- -Improvement of Student Teaching (New 
York: Hunter College of the City University of New York, 1962). U.S. 

Office of Education, Government No. 730035. (Mimeographed.) 

°Marie Hughes, Development of the Means for the Assessment of the 
Quality of Teaching in Elementary Schools (Salt Lake City: University 

of Utah Press, 1959). 

27 

'N. A. Flanders, "Interaction Analysis in the Classroom: A Manual 

for Observers" (unpublished manuscript. University of Michigan, Ann 
Arbor, I960} - 

28 David Ryans, Characteristics of Teachers : Their Description . Com - 
parison , and Appraisal (Washington, D.C.: American Council on Education 
1960). 
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Under a grant by the Fund for the Advancement of Education, Berry 
studied the question, "Does completion of education courses prescribed 
for certification make any difference in the effectiveness of beginning 
teachers?" Each of 76 first-year teachers having none or only some of 
the prescribed sequence of education courses was paired with the best 
"match" that could be found from a pool of 343 certified beginning 
teachers (age, quality-point average, college major, teaching assign- 
ment, extent of work in education). A modified Ryans' Classroom Ob- 
servation Record was used to observe each teacher five times during 
the year: twice by professional educators, twice by other professionals 

(civil engineer, lawyer, physician, social worker) and once by a general 
observer (a former school superintendent) who visited all teachers par- 
ticipating in the study. The observers were not informed of, and in 
general were not aware of, the specific problems being investigated nor 
did they know about the training backgrounds of the teachers observed. 
The fully certified beginning teachers who had completed the prescribed 
courses in education were, as a group, consistently and significantly 
rated to be more effective than the provisionally certified teachers 
who lacked all or part of the sequence in education courses. The ob- 
servers from professional fields other than education recognized the 
superiority of the fullg^prepared teachers to about the same degree 
that the educators did. 

Bellack and Davitz used a tape recorder and verbatim transcrip- 
tions of four class lessons in 15 different classes in social studies 
to study the teaching process through analysis of the linguistic be- 
havior of teachers and students in the classroom. The study focused 
on language as the main instrument of communication in teaching. The 
data were coded according to certain pedagogical moves (structuring, 
soliciting, etc.) and the results were summarized according to per- 
centages of the various activities. 

Many suggestions were obtained from the summary of contemporary 
research on teacher .effectiveness by Biddle and Ellena. 



29 John R. Berry, Professional Preparation and Effectiveness of 
Beginning Teachers (Coral Gables, Florida: Graphic Arts Press, 1960). 

3° Arno Bellack and Joel R. Davitz, The Language of the Class - 
room (New York: Institute of Psychological Research, Teachers 

College, Columbia University, 1963). 

31 Bruce J. Biddle and William S. Ellena, Contemporary Research 
on Teacher Effectiveness (New York: Holt, Rinehart and Winston, 

1964)^ 
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Several studies which were not used in designing the research pro- 
gram proved helpful as the project progressed. The work of Bush, Allen 
and Boyan at Stanford on the Experimental Secondary Teacher Education 
Program suggested useful procedures. ^ Hilda Taba's experiment with 
teaching for thinking helped shape the staff's perceptions .33 The later 
reports of Smith's study of the logic of teaching proved helpful. ^ An 
interesting compilation of various systems for observing classrooms has 
been prepared by Simon and Boyer. ^ Studies by Yee,36 Cypher t.3? Fall, 
Mars, 39 and Turner^-O proved helpful in many ways. Medley's subsequent 



38 



32 

Bush, Boyan, and Allen, 0 £. cit . 

33 

Taba, Levine, Elzey, op. cit . 

34 b # Othanel Smith, et al . , A Study of the Strategies of Teaching , 

USOE Cooperative Research Project No. 1640 (Urbana, 111.: Bureau of 

Educational Research, University of Illinois, 1967). 

3 5 Anita Simon and E. Gil. Boyer (eds.). Mirrors for Behavior --An 

Anthology of Classroom Observation Instruments , under the provisions of 
Title IV ESEA of 1965 in cooperation with the USOE Research Contract 
OEC 1-7-062867-3053 (Philadelphia: Research for Better Schools, Inc., 

1967). 

3^ Albert H. Yee, The Student Teacher Trend , research report to the 
U.S. Office of Education (Austin, Tex.: University of Texas, 1967). 

37 

Fredrick R. Cyphert and Ernest Spaights, An Analysis and Pro - 
jection of Research in Teacher Education , USOE Cooperative Research 
Project No. F-015 (Columbus, Ohio: Ohio University Research Foundation, 

1964). 

33 Charles R. Fall, et al. , Individualized Instruction in Teacher 
Education. Parts I and II and The Mary vale Project (Buffalo, N.Y.: 
Inter-University Project One at State University of New York at Buffalo, 
Cornell University, The University of Rochester, and Syracuse University 
with the support of the Ford Foundation, 1948). 

39 

Walter Jerry Mars, "A Study Comparing Two Ways of Training 
Students to Observe the Classroom Teacher's Verbal Behavior" (Doctoral 
dissertation, Syracuse University, Syracuse, N.Y., 1964). 

^ Richard L. Turner, Problem Solving Proficiency Among Elementary 
Teachers , USOE Cooperative Research Project No. 1262 (Bloomington, 

Ind.: Institute of Educational Research, 1964). 
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work as presented in recent publications and discussed in personal con- 
ferences served to sharpen the staff's perception of the problems of 
defining teacher behavior. * 



Research Related to Criteria To Be Used in Evaluating 
Student Teacher Behavior 

Criterion I - - Under s tand ing . Fr iendly vs . 

Egocentric . Aloof 

Criterion II --Planned, Organized , Responsible vs. 

Unplanned , Disorganized , Irresponsible 

Criterion III - - Stimulating , Imaginative , Surgent vs. 

Dull , Routine, Unimaginative 

The most extensive study of teachers to date, the Character is t ic s 
of Teachers study directed by Ryans, had many implications for this re- 
search. ^ The purpose of Ryans' research was to find the traits and be- 
haviors of classroom teachers that are significantly related to teacher 
effectiveness . 

During the more than six years of the study, approximately 100 sepa 
rate research projects were carried out, and more than 6,000 teachers in 
1,700 schools and about 450 school systems participated in the research. 
Many of the studies involved classroom observation by carefully trained 
and retrained observers to discover patterns of teacher behavior. 

In the teacher characteristics study, the observer, after observing 
a class for about 50 minutes, made assessments on each of 25 dimensions 
of the teacher's behavior and then recorded his assessments in the form 
of ratings on seven-point scales. 

As a result of this direct observation and assessment of teacher 
classroom behavior and subsequent statistical analyses of the measure- 
ment data, several interdependent patterns of teacher behavior were sug- 
gested. Three in particular appeared to stand out in separate factor 
analyses of both elementary and secondary teacher data: 

Pattern X — warm, understanding, friendly vs. 

aloof, egocentric, restricted teacher behavior 



Donald M. Medley, "The Language of Teacher Behavior: Communicating 

the Results of Structured Observations to Teachers" (paper presented at 
Annual Meeting of American Educational Research Association, February, 

1967) . (Mimeographed . ) 

Donald M. Medley and Donald L. Lantz, "Classroom Application of 
Teacher Behavior Research" (paper presented at the Annual Meeting of the 
American Educational Research Association, February, 1967). (Mimeographed.) 

Donald M. Medley, Joseph T. Impel lit tere, and Lou H, Smith, "Coding 
Teachers' Verbal Behavior in the Classroom," a manual for users of OScAR 4V. 
(Mimeographed copy provided by Medley.) 
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Ryans, o£. cit . 
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Pattern Y--responsible, businesslike, systematic vs. 

evading, unplanned, slipshod teacher behavior 

Pattern Z- -stimulating, imaginative, surgent vs. 
dull, routine teacher behavior. 

Ryans does not assert that all teacher behavior falls into one of 
these three patterns suggested by the factor analyses. He does, how- 
ever, insist that practical experience as well as empirical data indi- 
cates that these are three of the principal areas involved in inter- 
personal relations, and that they might well be given basic considera- 
tion in the theory of teacher behavior. These three patterns of teacher 
behavior which stood out in separate factor analyses of observational 
data in the Characteristics of Teachers study have been incorporated as 
categories in the SSTPP and serve as evaluative criteria. 

Criterion IV — Perceives Self as Competent vs . 

Perceives Self as Less Than Adequate 

In a publication of the Association for Supervision and Curriculum 
Development, four outstanding college professors, who have devoted much 
time to research in the area of the adequate personality, agreed on some 
striking statements concerning the importance of a positive view of self. 
According to these authors, people who are relatively adequate and self- 
actualizing have, positive views of self. They tend to see themselves as 
liked, wanted, worthy, and able to do a good job of whatever they under- 
take. On the other hand, people who are relatively inadequate tend to 
have a low estimate of their ability to deal with problems. They tend 
to view themselves as unliked, unwanted, and unlikely to succeed. 

In concluding their chapter "The Positive View of Self," they stated 
that people who are not comfortable with children or who cannot create 
an atmosphere which encourages the development of more positive selves 
should be encouraged to seek occupations other than teaching. Further- 
more, they state that teachers who destroy the selves of children should 
be helped to develop more positive views of self or be removed from the 
profession. Teachers and children, they explain, can be helped to de- 
velop more adequate selves in an atmosphere in which they experience 
success which fosters a positive view of self.^ 

In another chapter of the same yearbook. Combs stated that there 
are four characteristics of the perceptual field of the truly adequate 
person. The characteristics that he listed are: M (l) a positive view 



43 

Arthur W. Combs (ed.). Perceiving. Behaving. Becoming . Yearbook, 
1962 (Washington, D.C.: Association for Supervision and Curriculum 

Development, 1962), p. 100 

44 Ibid. , p. 117 
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of self, (2) identification with others, (3) openness to experience and 
acceptance, and (4) a rich and available perceptual field." ^ The con- 
clusion to be drawn from this and other sections of the book is that a 
positive view of self is absolutely essential to adequate personality. 
However, a positive view of self alone does not always assure an ade- 
quate person. 

In a survey of the research concerning self-perceptions. Bills found 
that most college students could be divided into three approximately equal 
groups based on their perceptions of themselves and their peers. The 
three groups were : 

(1) People who accept themselves and who believe that 
other people in their peer group are equally or 
more accepting of themselves .... 

(2) People who are rejecting of themselves but who 
believe that other people in their peer group 
are more accepting of themselves .... 

(3) People who accept themselves but who believe 
that other people in their peer group are not 
as accepting of themselves. ® 

He found that 93.1 percent of the college students and 90.9 percent 
of the high school seniors studied could be included in the three groups 
listed above. He also found research to indicate that when superinten- 
dents are asked to judge the success of principals, supervisors, super- 
vising teachers and assistant superintendents, they designated those of 
the first type listed above as most successful, those of the second type 
as next most successful, and those of the third type as least successful. 

The research by Bills would seem to indicate that the persons who 
hold low estimates of themselves and high estimates of others constitute 
the middle group as far as rated success in leadership positions is con- 
cerned. People who hold high estimates of themselves and high estimates 
of others are generally rated higher than those who hold low estimates of 
themselves. In view of Bills' conclusions and those reached by other 
authors, the relationships between this criterion of student teacher per- 
formance and other criteria included in this investigation will be analyzed. 
It may very well be that this criterion is positively related to good 
teaching only when combined in certain ways with other criteria. 

Combs suggests a model for a teacher education program which is 
built around the self-concept of the teacher. ' 



45 Ibid. , p. 51 

46 

Robert E. Bills, About People and Teaching . Bulletin of the Bureau 
of School Service, Vol. XXVIII, No. 2 (Lexington: University of Kentucky, 

December, 1955), p. 20. 

^ Arthur W. Combs, The Professional Education of Teachers (Boston: 
Allyn & Bacon, 1965). 
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Criterion V — Has Mastery of Facts and Organizing Pr inciples of Field vs . 

Has Only Minimum Knowledge of Field 

This criterion suggests that the student teachers who rate high have 
more than a superficial acquaintance with the teaching subject. It sug- 
gests that the student understands the important concepts of the subject 
and the rationale upon which it is developed. A student teacher who ranks 
high in this respect would recognize the most important and significant 
knowledge in his f ield- -concepts, generalizations, relationships, and specu- 
lation on future developments- -instead of isolated factual knowledge. 

This concept was the focus of the Woods Hole Conference as reported 
by Bruner in his book The Process of Education . The organizing principles, 
called "structure" by Bruner, are the basic ideas of how concepts in a 

* lx ft 

subject field are related. 

Hunt and Metcalf stress this when they discuss the necessity for 
generalizations in teaching. A true generalization is timeless in quality, 
referring to past, present, and future. Discrete or single insights or 
items or information do not by themselves have meaning or usefulness. A 
fact can function in thought only when it comes to have evidential charac- 
ter . . . encompassing specifics in the general. The only usable--and 
therefore worthwhile- -"background" consists of if-then-always generali- 
zations. The only role which facts can play in meaningful learning is 
to function as evidence in a conceptualization. It should therefore be 
clear that teaching . . . must lead to generalization. 9 

More recently Broudy, Smith and Burnett have pointed out that dif- 
ferent levels of factual knowledge exist. They indicate that some factual 
details are enormously important for both interpretive and applicative 
uses while others are of minor import. Another dimension is injected as 
they indicate that the context in which facts are used makes a great deal 
of difference as to what facts are relevant. What is important to a par- 
ticular person or in a particular situation may not be as important to 
other people or in different situations 



Jerome Bruner, The Process of Education (Cambridge, Mass.? 
Harvard University Press, 1962). 

49 

Maurice P. Hunt and Lawrence E. Metcalf, Teaching High School 
Social Studies (New York: Harper and Brothers, 1955), pp. 37-41. 

5° Harry S. Broudy, B. Othanel Smith, and Joe R. Burnett, Democracy 
and Exce 1 lence in American Secondary Education (Chicago: Rand McNally, 

1964), pp. 19-21. 
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Criterion VI - - Commun i ca te s Well and Empathetically vs. 

Communicates Ineffectively and Perfunctorily 

Criterion VII -- Classroom Discourse Characterized by Reasoning 

and Creative Thinking vs . 

Classroom Discourse Characterized by Simple Recall 

The research studies mentioned by Smith, Hughes, Flanders, Ryans, 
and Bellack are especially relevant for studying the teacher's linguistic 
behavior and classroom discourse. Aschner's work in analyzing classroom 
discourse is helpful. 

Criterion VIII - -Directs Attention to the Logical Operations in 

Thinking vs . 

Fails to Call Attention to the Logical Operations 
in Thinking 

This criterion grows out of the often -expressed need for a metho- 
dology for reaching consensus in our democratic society. One necessary 
skill is the ability and willingness to recognize the value structure 
which underlies the positions taken by different individuals. Also in- 
volved is the ability to apply the appropriate logical analysis to the 
different positions. The qualities called for in Criterion VIII were 
explored well in the Twenty-eighth Yearbook of the National Society of 
College Teachers of Education. Wilson gives a relatively simple analy- 
sis of the semantic and logical aspects of this category. 53 

Criterion IX- - High Professional Potential vs. 

Low Professional Potential 

The recent study on the content of a teacher education program by 
LaGrone has many suggestions for Criterion IX. 



“ >i Mary J. Aschner, The Analysis of Classroom Discourse - -A Method 
and Its Uses (unpublished doctoral dissertation. University of Illinois, 
Urbana, 1958). 

52 Kenneth D. Benne, George E. Axtelle, B. Othanel Smith, and 
R. Bruce Raup, The Discipline of Practical Judgment in a Democratic 
Society . 1943. (Reprinted as The Improvement of Practical Intelligence . 
New York: Harper, 1950.) 

Wilson, o£. cit o 

54 Herbert LaGrone, A Proposal for the Revision of the Pre-Service 
Professional Component of a P rogram of Teacher Education (Washington, 
D„C. : American Association of Colleges for Teacher Education, 1964). 
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CHAPTER III* 



DATA COLLECTION AND ANALYSES 



The reliability of each of the nine criteria of the SSTPP was ana- 
lyzed separately and also studied under five experimental conditions. 
The five conditions, called treatments, referred to the different ways 
of data collection; the college supervisor was the experimental or 
treatment unit. 



Data Collection 

In treatment 1, each college supervisor observed a student teacher 
on two visits, with the restriction that no student teacher was observed 
by more than one college supervisor. The college supervisors on each of 
two visits rated the student teacher's performance in terms of the nine 
criteria of the SSTPP. At least two weeks elapsed between visits to the 
same student teacher. 

Treatment 2 required that a college supervisor observe a student 
teacher on four visits, with the same restriction that no student teacher 
was observed by more than one college supervisor. On each of the four 
visits, the college supervisor rated the performance of the student teacher 
on the nine criteria. The time between visits was at least two weeks. 

In treatment 3, the college supervisors were divided into teams, with 
two college supervisors on a team. The team of two college supervisors 
then observed a student teacher on one visit. During the visit, each mem- 
ber of the team rated the student teacher independently. Student teachers 
were rated only once by a team and no student teacher was observed by more 
than one team. 

Treatment 4 was a variation of treatment 1. A college supervisor ob- 
served and rated the student teacher on two different occasions during 
the same day. That is, the college supervisor rated the student teacher's 
performance during a morning class and later that same day rated his per- 
formance in an afternoon class. Moreover, no student teacher was observed 
by more than one college supervisor. 

Treatment 5 was a modification of treatment 3. Treatment 5 was added 
to test the effects of more specific definition of the points on the cri- 
terion scale and the effects of a forced choice for criteria VII and VIII. 
A team of two college supervisors observed and rated the student teacher 
on one visit. 



*This chapter was written by Howard Rogers, a member of the staff of 
the Institute for Research in Human Behavior, Indiana State University. 
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For treatments 2, 3, 4, and 5, student teachers were randomly selected 
from the population. Treatment 1 included all student teachers supervised 
by the Division of Teaching. 



Purpose of the Treatments 

The treatments were so designed that by comparing them, certain spe- 
cific questions could be answered. The treatments differed in the type of 
reliabilities gathered, the number of visits, and the time lapsed between 
visits. Table 3.1 summarizes these differences. Treatments 1, 2, and 4 
generated intra-observer reliabilities and tested the question: How much 

did the ratings of the same observer show agreement? 

Treatment 3 generated inter-observer reliabilities and tested the 
question: How much did the ratings of two observers, judging the same 

student teacher, agree? 



TABLE 3.1 

TREATMENT CLASSIFICATION 



Treatment 


Type of Reliability 


Number of Visits 
Per Student 
Teacher 


Time Between Visits 


1 


Intra -Observer 


2 


2 weeks 


2 


Intra-Observer 


4 


2 weeks 


3 


Inter -Observer 


1 


- - - - 


4 


Intra-Observer 


2 


same day 











Comparing treatments 1 and 2 showed the effects of number of visits 
on their respective reliabilities, since the treatment designs differed 
only in respect to the number of visits. Comparing treatments 1 and 4 
revealed the effects of the time between visits on the reliabilities. 



Technique of Analysis 

The reliability of the nine criteria of the five treatments was 
determined by means of analysis of variance (ANOVA) . For multifacet 
data. Medley and Mitzel^ suggested that the ANOVA was the appropriate 



i Donald M. Medley and H. E. Mitzel, "Measuring Classroom Behavior by 
Systematic Observation," N; L. Gage (ed.). Handbook of Research on Teaching , 
Chapter 6. American Educational Research Association (Chicago: Rand McNally, 
1963). 
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way of determining reliability. In estimating reliability from the ANOVA, 
reliability was defined as the ratio of the true population variance to 
the total population variance. This definition means that any contribu- 
tion to the variance by a facet, except the one in which the experimenter 
was interested, was considered extraneous (error variance) and, in accord- 
ance with the definition, contribution by extraneous facets reduced 
reliability. The ANOVA not only allowed the experimenter to ascertain 
the amount of variance contributed by each facet, but it also permitted 
the experimenter to analyze variations in reliability with changes in 
the sample size of any facet. Reliability determined from the ANOVA 
could be drastically different from reliability determined from a product- 
moment correlation. Medley and Mitzel stated: 

Reliability {[from the ANOVA definition) can be low even though 
observer agreement is high for a number of reasons. For example, 
observers might be able to agree perfectly on the number of 
seats in a room, yet if the number of seats in all rooms is equal, 
or nearly so, the reliability of seat counts as a measure of 
differences between classes will be zero. Near-perfect agreement 
could also be reached about the number of boys in a room wearing 
red neckties; but if every boy changed the color of his tie every 
day, the reliability of these counts would be zero. 

For reliability determined from the ANOVA to be high, the variance due 
to "the facet of interest" must be large relative to other sources of 
variance. However, an advantage of the ANOVA is its use in suggesting 
what facets should be deleted and also added to a future study. For a 
detailed explanation of estimating reliability by the analysis of vari- 
ance, the reader is referred to the cited study by Medley and Mitzel and 
to Gleser et al. 



Reliabilities of the Treatments 

Factors in the treatments could be subjected to various interpreta- 
tions; however, it must be recognized that each college supervisor's 
ratings were considered independent. Also, since treatments 1, 2, and 
4 used the same statistical design, the three treatments are discussed 
first and some of their data are presented in the same tables for purposes 
of comparison. 



Intra-observer Reliability . The reliabilities of criteria VII and 
VIII are not shown for treatments 1, 2, 3, and 4. The reason for their 
deletion was that at least 30 per cent of the ratings for these two cri- 
teria were "suspended judgments"; the college supervisor marked the 
columns N (non- sufficient evidence for judgment) on these occasions. 



2 Ibid ., p. 310. 

^G. C. Gleser, L. J. Cronbach, and N. Rajaratnam, "Generalizability 
of Scores Influenced by Multiple Sources of Variance," Psy chome tr iker . 
Vol. 30, 1965. 
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Attempts to incorporate the "suspended judgments" into the statistical 
analysis were unsatisfactory. Moreover, the number of suspended judg- 
ments was further evidence of the difficulty of rating student teachers 
in the two criteria and this fact could be considered proof of their 
"unreliability. " 

In treatments 1, 2, and 4, the experiment was a partially hierarchical 
design. Student teachers were nested under college supervisors, and 
visits were crossed with college supervisors and student teachers. How- 
ever, it should be noted that even though the three treatments employed 
the same statistical design, the levels of a factor (visits) and/or the 
definition of a factor (visits) were different in the three treatments. 

The statistical model for the three separate treatments was: 

Xcsv s U + Ac + Bs(c) + Cv + ACcv + ABCs(c)v 

where c, s, and v were college supervisors, student teachers, and visits, 
respectively. 

Table 3.2 and Table 3.3 summarize the pertinent information 
needed to estimate reliability. First, Table 3.2 presented the sources 
of variation, the degrees of freedom associated with each source, the 
expected mean square and the obtained mean square. Estimations of the 
variance components were derived from information contained in Table 3.2. 
The derived estimates were obtained by setting the expected mean square 
components equal to their respective obtained mean squares and solving 
the resulting set of linear equations in terms of each variance component; 
that is,(V*sv(c) * S 2 sv(c) and£Hsv(c) + stf^cv * S^cv, etc. By solving 
each equation in turn, all the population variances ) can be written 

in terms of the obtained mean square values. The formula for estimating 
variance components from the obtained mean squares is shown in Table 3.3. 

To obtain the reliability of the criteria, the total population vari- 
ance and true population variance must be estimated. The estimation of 
the total population variance depended upon the experimental design. For 
the three treatments, the total population variance equaled: 

tf 2 c + ^tf^cv + Iq^c) + ^s(c)v 
and the true population variance equaled: 

(The design and analysis of the data were equivalent to design 4 general- 
ized to Universe A in Gleser et al^ ) 

In this design, the variance due to visits dropped out, because the 
effects of the visit factor were the same for all college supervisors. 

The reliability formula for the three treatments was: 

+ 1 fl^cv + I q^s(c) + i_ 0-2s(c)v 

V D SV 



4 

Ibid. 
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TABLE 3.3 



FORMULA FOR DERIVATION OF VARIANCE COMPONENTS 
FOR TREATMENTS 1, 2 AND 4 



<r 2 ° 


= i_(S^c - 


S 2 cv - S 2 s (c) + S 2 s (c) v) 




VS 




0 2 s(c) 


= l(s 2 s(c) 

V 


- S 2 s (c)v) 


<?v 


= £s< s2v ' 


S 2 cv) 


ff 2 CV 


= ^(S 2 cv - 


S 2 s(c)v) 


<r 2 s(c)v 


= S 2 s(c)v 





The reliabilities for treatments 1, 2, and 4 are shown in Table 3.4. 
For treatment 1, the reliability of each criterion was based on eleven 
college supervisors, each observing twenty-eight students on two visits. 
For treatment 2, the reliability of each criterion was based on four 
college supervisors, each observing five students on four visits. For 
treatment 4, the reliability of each criterion was based on four college 
supervisors, each observing five students on two visits. Basically, the 
reliabilities of treatments 1 and 2 were moderately low, while that of 
treatment 4 was extremely low. (Adequate reliability was considered to 
be .80 or higher.) Over the treatments, there was no constant trend of 
one criterion* s reliability being higher than that of another. 



TABLE 3.4 

RELIABILITY OF SEVEN CRITERIA 
TREATMENTS 1, 2 AND 4 



Criterion 


Treatment 1 


Reliability 
Treatment 2 


Treatment 4 


I 


.69 


.66 


.23 


II 


.65 


.81 


.00 


III 


.32 


.69 


.00 


IV 


• 

Ci 

00 


.73 


.00 


V 


. 66 


.21 


.00 


VI 


.50 


.82 


.00 


IX 


.39 


.66 


.00 
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Reasons for Reliability Results . The magnitude of variance components 
afforded a method of comparing the three treatments, since the estimated 
variance components were independent of sample size of the facets. An 
examination of the variance components in Table 3.5 revealed certain con- 
sistencies and differences between the three treatments. 



In treatments 1 and 4, the magnitude of the variance components 
showed consistent trends over the seven criteria. ^r^s(c)v (student- 
teachers-within-a-college-supervisor component) had the largest absolute 
magnitude for the seven criteria and also its relative magnitude compared 
to <T v (visits component), (f^cv (visits x college supervisors component), 
and flr^c (college supervisors component) was large. The relative and abso- 
lute magnitudes of the last three estimated variance components were quite 
small. The relative magnitude of O^s(c) meant the variation of student 
teachers under (within) a college supervisor was greater than the varia- 
tion between college supervisors w 2 c). Medley and Mitzel reported 
similar results in their observational study of classroom behavior: the 

variations within a classroom were always greater than variations between 
classrooms.® Although the magnitude of (j^s(c)v was smaller than^sfc) 
over the seven criteria, in most cases, its relative magnitude compared 
to <r 2 v, <r 2 cv and cr 2 c was large. The size of <y 2 s(c)v (residual component) 
showed that there were factors affecting the ratings which were not 
isolated in this experiment. 

In treatment 2, the criteria seemed to divide into two groups. The 
relative magnitudes of the variance component in criterion V were similar 
to those of treatments 1 and 4. Criteria I, II, III, IV, VI, and IX, 
however, showed another pattern. As in treatments 1 and 4, the relative 
magnitudes of cr 2 s(v) and ^s(c)v compared to and 0%cv were large; 
but for these six criteria of treatment 2, unlike the other treatments, the 
relative magnitude of C^c was large. 

The magnitude of meant that the college supervisors were 

giving differential ratings to their student teachers. That is, the 
college supervisors did not assign the same rating to their student 
teachers; however, in treatments 1 and 4, the difference between the 
average ratings of the college supervisor was small compared to the 
differences between their average ratings of student teachers. In 
treatment 2, the difference between college supervisors on six criteria 
was higher than in the other two treatments, indicating that the relia- 
bility for the six criteria was higher than those found in the other 
treatments. The residual error was large across criteria and treatments. 
This suggested that more factors should have been included in the statis- 
tical model. 



Examination of the variance components raised several related ques- 
tions. First, why was (college supervisors components) in treatment 

4 so small (zero in five out of the six criteria) when compared to 
in treatment 2? The answer could be seen in the derivation of gr^c . The 



5 0p. cit . 
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formula was : 



d*2c = JL(S 2 c - S 2 s(c) - S 2 ac + S 2 s(c)v) 

In treatment 4, the magnitude of S 2 s(c) (obtained mean square of student- 
teachers-within-a-college supervisor) was so much greater than the other 
obtained mean squares, including S 2 c, that the sum of the four obtained 
mean squares was negative (which was transformed to zero, since no nega- 
tive variance, could, occur). The magnitude of i n treatment 2 was 

never greater than (jr^c. 

But this difference in the relative size of S 2 c and S 2 s(c) in the 
two treatments generated another problem. Since in both treatments, the 
college supervisor rated student teachers from the same population, why 
should the variance of the student teachers and college supervisors in 
the two treatments be so different? Several alternative explanations 
were examined. The results of the examination revealed no consistent 
reason why the variance components should be so different in the treat- 
ments, except chance variations. Since the intercorrelations between the 
seven criteria were approximately .5, any random difference between treat- 
ments would be expected to produce differences in all the criteria. 

A second related question was: Why were the reliabilities in treat- 

ment 4 so low? Since cT^c was zero or relatively small in all cases, the 
reliability, as a consequence of the definition used, must also be zero 
or insignificant. 

Since the error variation was so large, a product-moment correlation 
between two visits was performed. The correlation for treatments 1 and 4 
was between the first and second visit. For treatment 2, it was between 
the first and third visit, since the time lapse between them was equivalent 
to the time lapse between the first and second visit in treatment 1. Table 
3.6 shows the results. The analysis was performed on the combined data of 
all the college supervisors. The result showed that the correlation between 
visits was highest in treatment 4 and approximately equivalent in treatments 
1 and 2, the exception being criterion VI. For Criterion VI, treatment 2 
was slightly higher than treatment 4. The correlations suggested that the 
shorter the interval between visits was, the higher the product -moment 
correlation between the visits would be. This fact might mean that with 
a small time interval, the college supervisors remembered their previous 
ratings and on the second visit, attempted to minimize--whether con- 
sciously or unconscious ly--any difference between the two ratings. Al- 
though pooling the data of all the college supervisors, the correlations 
could be used as a crude measure of correlation between the two visits. 

As had been previously mentioned, an advantage of using an ANOVA 
for determining reliability was that the estimated variance components 
could be used to calculate reliabilities based on different sample sizes. 

The purpose of varying the sample size of the facets was to allow the ex- 
perimenter to estimate the adequacy of the reliability for various con- 
ditions: if the reliability of a criterion was low, the experimenter, 
using- the estimates of various variance components from the original study, 
could determine which facets should be increased to obtain higher re- 
liability. 
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TABLE 3.6 



PRODUCT-MOMENT CORRELATIONS OF CRITERION RATINGS 
IN TREATMENTS 1, 2 AND 4 



Criterion 


Treatment 1 
N = 499 


Treatment 2 
N = 20 


Treatment 4 
N = 23 


I 


.63 


.59 


.80 


II 


.62 


.61 


.69 


III 


.59 


.42 


.68 


IV 


.60 


.61 


.77 


V 


.64 


.60 


.69 


VI 


.53 


.62 


.57 


VII 


.42 


.49 


.59 


VIII 


.41 


.39 


.73 

I 

I 


IX 


.68 


.62 


1 

.80 | 



From the reliability formula, r = + I ^cv + _ ^s(c) + 0 2 s(c)v, 

it could be easily shown that increasing the number of student teachers and 
the number of visits would increase the reliability, unless the estimated 
equaled zero. In that case, increasing sample size could not affect 
reliability, which would always be zero. 

To gauge the adequacy of the reliability in the three intra-observer 
treatments, a projected study, using the original estimated variance com- 
ponents, was performed. In the projected study, each college supervisor 
observed the same two student teachers on ten visits. The choice of the 
sample size was based on the idea that the reliability of a minimal sample 
of student teachers should be high and the way to accomplish this end was 
to increase the number of visits (within reason). The results of the 
projected study are shown in Table 3.7. The reliabilities of the seven 
criteria were low. The reason f or the low reliabilities was that the 
magnitude of student teacher variance was unaffected by changes in the 
number of visits and thus was relatively large. 

The size of some variance components suggested that they were not 
significantly different from zero. An F test was performed on the data 
to ascertain if some of the sources of variance could be pooled. To 
apply the F test, it was assumed that all the factors and the residual 
variation were normally distributed. Tables 3.8, 3.9 and 3.10 show the 
results of the F test for treatments 1, 2 and 4, respectively. For the 
college-supervisors factor, a quasi F ratio was used. At this stage, 
the value of the F test could bq its use as a guide in suggesting what 
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TABLE 3.7 



PROJECTED RELIABILITY OF THREE TREATMENTS 



i Criterion 

* 


Treatment 1 


Treatment 2 


Treatment 4 


I 


.19 


.•56 


.11 


II 


.20 


.66 


.00 


III 


.06 


.62 


.00 


IV 


.20 


.55 


.00 


V 


.17 


.11 


.00 


VI 


.12 


.69 


.00 


IX 


.07 


.51 


.00 
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factors could be dropped from a model of a future study. Across treatments 
and criteria, none of the sources of variance were consistently non-significant. 
Therefore, caution would require that all the sources be retained. Moreover, 
it would not be advisable to drop factors, until adequate reliability was 
obtained. 



Inter-Observer Reliability 



For treatment 3, the appropriate statistical model was: 

x tcs =* U + A t + B c(t) + C s(tc) 

where t, c, and s are the teams, college supervisors, and student teachers, 
respectively. 

In this design, college supervisors are nested under the team factor 
and student teachers are nested under both college supervisors and team 
factors. 

Table 3.11 summarizes the pertinent information needed to estimate 
reliability. 

Based on the estimated variance components, the total population 
variance equaled: 

» 2(t) + | ^ o(t) + Es «^ s(ct) 

and the true population variance equaled: 

^(t). 

Therefore, the reliability of treatment 3 was: 

|f^(t)/o- 2 (t) + - (t) +i-^s(ct). 
v c C s 

The reliability of each variable was based on fifteen teams with two 
college supervisors on a team and each team observing two student teachers. 
The results are shown in Table 3.12. (The design and analysis of the data 
were equivalent to design 7 generalized to Universe A in Gleser et al.6) 

Table 3.12 revealed that the inter-observer reliabilities were moder- 
ately low. For comparison, the product -moment correlations are shown in 
Table 3.13. Examination of the variance component estimations in Table 
3.14 revealed that (j*^s (ct)— - the error term--was quite large relative to 
the other factors. The size of the error term implied that variables other 
than those considered in the design were influencing the ratings. Since 



6 0p. cit. 
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0 ^s(ct) was so large, it overshadowed the variance due to dPc (t) — the 
college supervisors-within-a-team. Therefore, the size of the variance 
components suggested that inter-observer reliability was reduced, because 
differences among student teachers had not been controlled or incorporated 
into the statistical design. To increase the reliability, either the 
number of college supervisors or the number of student teachers could be 
increased. A projected study was performed. Each team was composed of 
five college supervisors who observed two student teachers. The results 
are shown in Table 3.15. The reliabilities were higher than before, but 
most were moderate with only two reaching an adequate level of reliability. 
It would be possible to increase them, but the cost of adding more college 
supervisors might be prohibitive. 

TABLE 3.12 

INTER-OBSERVER RELIABILITIES FOR TREATMENT 3 



Criterion 


Reliability 


I 


.60 


II 


.48 


III 


.53 


IV 


.56 


V 


.34 


VI 


.45 


IX 


.46 



TABLE 3.13 

PRODUCT-MOMENT CORRELATIONS OF CRITERION RATINGS 

IN TREATMENT 3 



Criterion 


Reliability 


I 


.15 


II 


.51 


III 


.58 


IV 


.55 


V 


.52 


VI 


.55 


IX 


.48 
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TABLE 3.14 



ESTIMATION OF VARIANCE COMPONENTS IN TREATMENT 3 



Criterion 


I 


II 


III 


IV 


V 


VI 


IX 




.35 


.38 


.78 


.64 


• 

to 

oo 


.36 


.32 


(j * c (t) 


.00 


.00 


.00 


.00 


.00 


.00 


.00 


pPs (tc) 


.96 


1.63 


2.79 


1.99 


2. 11 


1.74 


1.49 



TABLE 3.15 

PROJECTED STUDY FOR TREATMENT 3 



Criterion 


Reliability 


I 


o 

oo 

• 


II 


.70 


III 


.74 


IV 


.80 


V 


.57 


VI 


.68 


IX 


.68 



Examination of the F ratios in Table 3. 16 suggested that the college 
supervisors-within-a-team factor was not significant and might be dropped 
from future models. However, the deletion could be done after another 
study verified that this factor was insignificant. 

Based on the original treatment, it was decided that a possible reason 
for the moderate reliabilities was that the observers’ frame of reference 
was dissimilar. Therefore, it was felt that a more rigid scale would pro- 
duce greater conformity in rating student teachers. In treatment 5, the 
scaling procedure for Criteria VII and VIII was modified. For these two 
criteria, the endpoints and midpoints were described in detail and specific 
examples for rating both extremes were identified. Table 3.17 shows the 
definitions used for Criteria VII and VIII. There were three differences 
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TABLE 3.17 



REVISED INSTRUCTIONS FOR CRITERION VII 



Score as a M 1 M 

If most of teacher's questions are open-ended or thought-provoking. 

If teacher frequently translates principles into terms which are in the 
pupil's fields of experience. 

Score as a "4" 

If teacher ignores good opportunities for thought part of the time and 
seizes them part of the time. 

Score as a M 7 M 

If students are never asked "why?" or "how?" 

If students are not permitted a moment to think of answer. 

If no analogies to students' experience are given. 

REVISED INSTRUCTIONS FOR CRITERION VIII 



Score as a M l" 

If teacher makes students aware of the problem and the process for solving 
it. 

If students actually comprehend the problem. 

Score as a M 4 M 

If teacher understands the problem and meaning of terms but fails to 
communicate it to students. 

If teacher assumes student will comprehend the process. 

Score as a M 7 M 



If teacher never identifies the problem nor defines terms 









between the new procedure and the old procedure. One was the elaboration 
of the midpoint and extremes. Another was that three practice sessions 
were held in which observers viewed video tapes of student teachers, com- 
pared their ratings and discussed the reasons for their different ratings 
until agreement was reached. Thirdly, the college supervisors were forced 
to make a judgment on every visit; "suspended" judgments would not be 
accepted. The remaining criteria in treatment 5 were not modified. 

The experimental treatment was similar to treatment 3. A team of 
two observers rated five student teachers on one visit. Since there was 
only one team, the statistical design for treatment 3 was inappropriate. 
The statistical design used in this study was: X sc ** A s + Bgc> where s 

represented a student teacher and c represented a college supervisor. 

Table 3.18 shows the ANOVA design for treatment 5 and Table 3.19 
shows the estimation of variance components. 



TABLE 3.18 

ANOVA DESIGN FOR TREATMENT 5 



Source of Variance 


DF 


ET555) 


Obtained^ MS 


Students 


4 


qf2 e rror + ctf 2 s 


S 2 s 


Within Students i 


1 1 


(f terror 





TABLE 3.19 

ESTIMATION OF VARIANCE COMPONENTS 






2 s = A(S 2 s “ S 2 error) 






c 

— c2 



error = S^error 



In this design, differences in ratings of a single student teacher, 
terror, were considered a source of error. Differences between student 
teachers, or^s, were considered an estimation of the true characteristic 
being measured and, therefore, this variance component did not contribute 
to the error. Thus, the reliability was ^ tf 2 error. For further 

detail, Winer has a discussion of this design. 7 



7 B. J. Winer, 
York: McGraw-Hill, 



Statistical Principles In Experimental Design (New 
1962) . 




Table 3.20 shows the reliabilities. The data supported the idea 
that a rigid frame of reference produced higher reliability. With the 
prescription of scale points for Criteria VXX and VXXX 9 the reliabilities 
of these two criteria now became the highest. Therefore, it would seem 
reasonable that to achieve uniformity of observers' ratings, the rating 
scale must be anchored, at the endpoints and midpoint, so the observers 
have a common frame of reference. Also, Criteria I and II now had the 
lowest reliabilities. The reason for this dramatic decrease was not clear 
when compared to treatment 3; however, it was possible that with all the 
emphasis in training on Criteria VII and VIII, the college supervisors 
may have subsequently ignored Criteria I and II. 



TABLE 3.20 

RELIABILITIES OF CRITERIA FOR TREATMENT 5 



Criterion 


Reliability 


I 


.44 


II 


.33 


III 


.91 


IV 


.87 


V 


.69 


VI 


.87 


VII 


.98 


VIII 


.94 


IX 


.89 



The detailed analysis of the previous treatment was not performed, 
because of the limited sample size and because interest was focused only 
on Criteria VII and VIII. Table 3.21 shows the variance components only 
for Criteria VII and VIII. The size of the error variance component was 
insignificant compared to the student teacher variance component, <f^s. 
However, it must be noted that changes in designs can shift reliabilities 
drastically and a true replication of treatment 3 might not have produced 
the same results. 



60 



TABLE 3.21 



VARIANCE COMPONENT FOR TREATMENT 5 



Criterion VII 



Criterion VIII 




4.08 



.20 



3.11 



39 



Discussion of Reliability 



Intra-observer Reliability . The results of treatments 1, 2 and 4 
revealed that the reliability of college supervisors’ ratings of two 
student teachers was low or moderately low. Even the product-moment 
correlation (pooled over college supervisors) revealed that over all the 
treatments none of the criteria consistently obtained a correlation of 
.80 or greater. This fact meant that either the college supervisors 
were inconsistent or the student teacher’s behavior was variable or both. 
Obviously, there was no simple way of testing these alternative explana- 
tions, since the data showed no systematic trends which could have been 
attributed to the student teachers or to the college supervisors. How- 
ever, a repeated measures design (Table 3.22) showed that the college 
supervisors did not change significantly over time. This evidence prob- 
ably indicated that the student teachers were variable. That is, the 
performance of the student teacher probably depended on the nature of the 
material he was teaching and how the class reacted to him. For example, 
in treatment 4, where the two visits were on the same day, a student teacher 
in most cases taught two different classes — subject matter and students — 
which probably accounted for the low reliability. However, it was still 
possible that college supervisors’ behavior was unsystematically variable. 

A comparison of the treatment variations showed significant differ- 
ences; however, none of the treatments reached an acceptable level of 
reliability (.80 or greater). 

Inter-observer Reliability . The inter-observer reliabilities found 
in treatment 3 were moderate. The projective study showed that with five 
college supervisors, the reliabilities of the criteria tended to approach 
the acceptable range (.80 or greater). However, having five college super- 
visors observe a student might be impractical in most cases. # 

When special training and methods were introduced, as in treatment 5, 
the reliabilities seemed to increase. The importance of treatment 5 was 
the initial training in which college supervisors were required to discuss 
their differences until agreement was reached at what the specific rating 
should be. Before this change, the initial training required a discussion 
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TABLE 3.22 
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of differences, although the agreement was very general: the student 
teacher seen on the video tape was rated high, medium or low on a cri- 
terion, but nc exact rating, such as ”4," would be agreed on. The 
standardized procedure used with criteria VII and VIII, which pre- 
viously had been so difficult to rate, now had the highest reliability. 

The reliability problem could be interpreted as a special case of 
discrimination learning. In the same way that a child learned to tell 
time, college supervisors could be taught to make similar judgments. 

The child repeated his estimate of the time, until the judgment agreed 
with his teacher. In treatment 3, no elaborate effort was made to test 
if the initial frame of references was the same. Treatment 5 elaborated 
a procedure for initial agreement on criteria VII and VIII and the re- 
sults were obvious. 



Additional Analysis 

The reliability analysis of the five treatments raised an additional 
question: Since the student teacher variance was so large, was the cause 
of this large variance due to the same systematic changes in the behavior 
of the college supervisors' responses with the passage of time. Four col- 
lege supervisors were studied over a four-year period; two ratings per year 
were randomly selected for four years for each of the college supervisors. 
The results of the analysis of variance, using the repeated measures de- 
sign, showed that the time variable had no significant effect on the rat- 
ings for any of the nine criteria (see Table 3.22). The results meant that 
the college supervisors did not change their ratings over time. However, 
it did not preclude the possibility that the college supervisors were un- 
systematically changing their ratings, or that the student teachers' be- 
havior was variable. Basically, the reason for the student teacher vari- 
ance was confounded in this study. 

In addition, from an earlier factor analysis, three factors were ex- 
tracted from the SSTPP. The justification for the extraction of three fac- 
tors was based purely on rational grounds, since the last factor was insig- 
nificant. The factors were a u personality" factor (criteria I, III, IV, VI, 
and IX), a "logical thinking 1 ' factor (criteria VII and VIII), and an "organ- 
ization-subject-matter" factor (criteria II and V). Since they appeared to 
be reasonable, factor scores were computed for the three factors and used in 
the validity studies. A factor score for an individual was the subject's 
standard score on the sixth criterion times the regression coefficient be- 
tween the factor and the criterion I, summed over the eight criteria. 

Also, the treatment data suggested that the nine criteria were not 
independent. A factor analysis offered a means of describing these in- 
terrelationships more succintly. A factor analysis was performed on the 
SSTPP (only criteria one through eight), using 1128 cases. The cornmu- 
nality estimation option employed in this study was the square of the mul- 
tiple correlation coefficients. The results in Table 3.23 show that the 
communalities (common variance) accounted for 58 percent of the total 
variance (or 4.67/8.00). The first factor accounted for 75 percent of 
the common variance and the second factor accounted for 22 percent of 
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the common variance. The other two factors were insignificant. The 
initial factorization revealed that two factors accounted for almost 
all of th common variance.* Table 3.24 shows the contribution of 
each criterion (based on the first two factors) to the common variance. 
The result shows that each test contributes approximately the same 
amount . 



TABLE 3.23 
FACTORS OF SSTPP 



Characteristic Roots 


Percent of Trace 


Factor 


I 


3.4904 


75% 


Factor 


II 


1.0604 


22% 


Factor 


III 


0.1064 


2% 


Factor 


IV 


4 . 6734 


1% 






4 . 6734 


100% 



TABLE 3.24 

COMMUNAL I TIES OF CRITERIA 





ri terion 


Communal ity 


I 


.4578 


II 


.5277 


III 


.6824 


IV 


.5423 


V 


.5381 


VI 


. 6040 


VII 


.5989 


VIII 


.5996 



*Using a different group of student teachers three factors were 
identified. They are described in Chapter IV. 



Table 3.25 shows the orthogonal factor matrix. The factor matrix 
showed that on factor I, the first six criteria had high loadings, while 
criteria VII and VIII had insignificant loadings «.35). But on factor 
II, the reverse was true: criteria VII and VIII had significant loadings, 

while the first six criteria's loadings were insignificant. Moreover, the 
first six criteria were performance variables: personality (I, III, IV, 

VI) or organization-of-subjec t matter variables (II, V). As a consequence 
of the criteria's definitions, it was reasonable to conclude that factor I 
was a "general appearance" variable and factor II was a "logical thinking 
variable. 



TABLE 3.25 



ORTHOGONAL FACTOR MATRIX (VARIMAX) OF SSTPP 



Variable j 


Factor 1 


Fac tor 2 


Criterion I 


0.6709 


0.0872 


Criterion II 


0.7179 


0.1106 j 


Criterion III 


0.8200 


0. 0995 


Criterion IV 


0.7341 


0.0574 


Criterion V 


0.7142 


0. 1673 


Criterion VI 


0.7652 


0. 1355 


Criterion VII 


0.1274 


0.7633 


Criterion VIII 


0.0954 


0.7684 

1 



The correlation among the oblique reference vectors was non-significant 
(.29) and rotation to an oblique reference structure did not appear to affect 
the factor loadings. Basically, the factors were orthogonal. 

In summary, the college supervisor viewed the student teacher in terms 
of two independent factors. The student teacher's behavior was rated 
independently along a "general appearance'' and along a "logical thinking 
dimension. 

Moreover, according to the definition, criterion IX was a global 
variable. It was an overall estimation of the student teacher's potential. 
Therefore, a stepwise regression analysis of the relationships between 
criterion IX of the SSTPP as the dependent variable and the other eight 
categories as the independent variables was performed. There were 499 
student teachers in the analysis. The resulting model was: 
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x 9 = -.2232 + .1540X1 + . 2225X 2 + . 1729X 3 + .0718X 4 + . 2071X 5 + 
.2027X6 + . 0197X 7 + . 0205X 8 



where Xf was a score on a criterion. The multiple R was .8869, which meant 
78.66 per cent of variance was accounted for by the regression equation. 
Examination of the weights for the criteria revealed that variables 1, 2, 

3, 5, and 6 have the highest weights. Except for criterion 5, the rest of 
the criteria could be characterized as personality variables. The best 
index of a student teacher's potential was his personality according to 
college supervisor's judgment. Variables7 and 8, the 'logical thinking 
criteria, had the lowest weight in the regression, equation. The finding 
meant that "logical thinking" ability was not a very important element 
in the college supervisor's rating of the student teacher's potential. 



CHAPTER IV 



THE TEACHER CLASSROOM ACTIVITY PROFILE 



Background 



The Teacher Classroom Activity Profile (TCAP), which was designed 
for one of the "treatments" of the experimental observations, evolved 
into a major investigation on its own. This is an instrument for re- 
cording the way the teacher spends his time in the classroom. The seven 
categories which finally emerged are: Management- -Non- Learning Activi- 

ties, Management --Learning Activities, Presentation, Conducting Recita- 
tion/Drill, Discussion/Random, Conducting Logical Thinking, and Calling 
Attention to the Process of Thinking. They reflect the bias of this in- 
vestigation toward the intellectual aspects of behavior. 

The seven categories and their definitions for classifying what the 
teacher does in the classroom were agreed upon after several trial runs 
and extensive staff discussion.* "Management- -Non-Learning" refers to 
the time spent in housekeeping activities and disciplining. "Manage- 
ment- -Learning" refers to time in which the teacher is monitoring the 
class while the students are engaged in study, work, viewing a film, 
giving reports, or taking a test-- time in which the teacher's role is 
a passive one. "Presentation" refers to the time the teacher is lec- 
turing, reading, or presenting any kind of information. "Recitation/ 
Drill" is used in the traditional sense of the teacher's asking for 
brief answers--time in which the teacher is orally discovering whether 
or not students have prepared their lesson. Drill and practice are in- 
cluded in this category. "Discussion/Random" as used in this instru- 
ment is a very technical term. It is defined on the basis of our experi- 
ence as "talk, talk, talk," or irrelevant verbal behavior as contrasted 
with logically structured discourse and represents the kind of stream- 
of -consciousness talk that seems to have little relevance to the purposes 
of the lesson. When discussion reveals a more purposeful direction it 
is classified as "Logical Thinking." Any time during which the teacher 
encourages thinking to take place, permits it to take place, or partici- 
pates in the thinking process is listed as Logical Thinking. "The 
Thinking Process" refers to the time in which the teacher consciously 
points out ways of improving the thinking process, clarifies the prob- 
lems, gets students to see the sources of their difficulty, helps supply 
the necessary information or the necessary technique for attacking a prob 
lem, or drives home the process through which students arrive at conclu- 
sions or make judgments. 



See Appendix B for instructions for use of TCAP and definitions 
and illustrations of terms. 



Both types of Management represent first- level intellectual acti- 
vity.* Presentation and Recitation/Drill represent second-level. Dis- 
cussion/Random may fall into either level one or level two. Logical 
Thinking represents the third level and Attention to the Thinking Pro- 
cess represents the fourth level. 

It should be emphasized that no attempt was made to judge the stu- 
dent teacher's behavior as to quality other than to place it in a cate- 
gory. Imperative or affective statements were not judged as accepting 
or rebuking. Presentation was judged neither for its accuracy nor its 
effectiveness. Logical Thinking and Attention to the Thinking Processes 
were not rated as to their rigor or precision. 

The categories were determined on the basis of the way in which the 
observer, by looking at overt teacher behavior, viewed the teacher's in- 
tentions. Whether or not the student teacher succeeded was of secondary 
importance. No presumption was made as to what constituted a desirable 
profile. The study attempted to discover what kinds of patterns of 
teacher behavior obtained in classes taught by student teachers. 

It was discovered that completed profiles were effective devices for 
helping the student to analyze his teaching and reconstruct his purposes 
and behavior. 

The relationships between TCAP categories and the analyses of the 
various levels of intellectual activity, kinds of statements, the teacher's 
intentions, and clue words are shown in Figure 4.1. 

Using the Teacher Classroom Activity Profile 

In practice, the observer records a continuous line starting at the 
beginning of class, moving through one of the seven categories. When an 
activity appears to have some elements of two categories a vertical line 
is used to indicate this relationship. For instance, if the teacher is 
making a presentation but asks a question which prompts the class to do 
some thinking, a line is dropped down into the thinking category. Simi- 
larly, there is considerable fluidity among the various categories. 

In actual practice, the three-minute intervals marked off in the form 
are frequently subdivided into thirds or one-minute intervals. At the end 
of the hour a summary is tabulated and the percentage of time spent in 
each of the categories is calculated. 

Originally, the TCAP was designed to be used for only ten-minute in- 
tervals during the observation. Its use proved to be so valuable that 
subsequently it has been used to cover the total observation. The re- 
cording instrument is printed on no-carbon-required (NCR) paper and after 
an observation the TCAP is used as the basis for a supervisor-student 
teacher conference. A copy of it is left with the student teacher, an- 
other copy retained in the file on the student teacher, and the third 
copy used for research purposes.** 



*See pages 25, 26 and 27 for explanation of levels of intellectual 
activity. 

**A copy of the Teacher Classroom Activity Profile form is included 
in Appendix B. £o 
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Since this investigation was concerned with studying what the teacher 
does, the TCAP, like the SSTPP, focused exclusively on teacher behavior. 
Obviously there is interaction between teacher and pupil but for the pur- 
pose of this study only teacher behavior was recorded. 

The TCAP, like the recording of classroom behavior as done by Medley 
and Mitzel, by B. 0. Smith, by the F landers -Amidon group, and by Arno 
Bellack, reports rather than evaluates. The TCAP does give a gross map 
of the kinds of activity in which the teacher engages in the classroom. 

The use of anecdotal notes and illustrative material on the TCAP observa- 
tion form makes possible a useful "reconstruction" of the teacher's activity. 
This is not to deny that observers have to make some judgments as to which 
category appropriately describes the teacher's behavior. But this kind of 
judgment is necessary in any kind of categorization. There is no attempt 
to evaluate the quality of the teacher's activity as is the case with SSTPP. 

It was discovered that observers could learn the techniques for using 
the TCAP in a relatively short amount of time and with a minimum of train- 
ing. As a result, the TCAP was widely used by other persons in the student 
teaching program- -departmental supervisers, cooperating teachers, and even 
pupils in the classes. 

Table 4.1 presents a summary of teacher classroom activity as reported 
in 1,097 observations made by the Division of Teaching staff and 264 obser- 
vations made by departmental supervisors during the two-year period 1966-67 
and 1967-68. Table 4.2 presents in graphic form the time distribution di- 
vided between academic-type classes and laboratory- type classes by staff 
members. Table 4.3 gives the mean percentages of time devoted to each cat- 
egory. 



Analysis of TCAP Data 

The most striking fact to emerge from the use of the TCAP is the small 
proportion of time devoted to Thinking and the Thinking Process as here 
defined. This fact helps explain the relatively low reliability observers 
obtained on Criteria VII and VIII which assessed the logical nature of 
classroom discourse and conscious attention to the process of thinking. 

When only six minutes, or ten percent, of an hour's observation are pro- 
viding data with which to assess the student teacher's performance one 
should not expect reliable results because of the limited time sample. 

This holds true also to a greater extent for Criterion VIII--Thinking Pro- 
cess which occupied only two percent of the time. Similarly, in the re- 
gression analysis Criteria VII and VIII played a very minor role in the 
global evaluation of the student. It seems quite logical that one of the 
reasons for this was the fact that only a limited amount of data was avail- 
able to the observer on which to make his assessments. 

An analysis of variance using the 2x2 factorial design was per- 
formed on each of the seven categories. One variable consisted of reports 
by Departmental Supervisors and reports by Staff. The other variable 
consisted of laboratory- type classes and academic-type classes. The 
means and the F ratio for these variables are reported in Table 4.4. 

In TCAP reports made by Division of Teaching Supervisors and Departmen- 
tal Supervisors no significant differences were apparent except with re- 
spect to the percentage of time classified as Discussion, where the F 
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MEAN PERCENTAGES OF TIME DEVOTED TO EACH CATEGORY OF TEACHER CLASSROOM ACTIVITY FOR LABORATORY -TYPE AND ACADEMIC-TYPE CLASSES 
AS REPORTED BY DIVISION OF TEACHING STAFF ACADEMIC N = 584 LABORATORY N = 513 
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TABLE 4.3 



MEAN PERCENTAGES OF TIME DEVOTED TO EACH CATEGORY 
OF TEACHER CLASSROOM ACTIVITY BY OBSERVERS AND BY TYPE OF CIASS 



TCAP Category 


Departmental 

Observers 


Staff 

Observers 


All Observers 
and 

All Classes 


Lab 

N = 112 


Academ. 
N = 152 


Lab 

N = 513 


Academ. 
N = 584 


Management- -NL 


5.84 


3.42 


6.66 


3.74 


5.10 


Management- -L 


22.16 


23.60 


26.76 


27.25 


27.03 


Presentation 


15.98 


25.65 


17.17 


23.32 


20.44 


Recitation/Drill 


23.59 


24.47 


29.27 


23.75 


26.33 


Discussion/Random 


22.34 


12.55 


13.89 


6.27 


9.82 


Logical Thinking 


9.84 


8.40 


5.62 


12.89 


9.49 


Thinking Process 


.93 


1.88 


.63 


2.75 


1.76 



ratio of 7.81 showed a significant difference at the .01 level as reported 
in Table 4.1. Departmental Supervisors reported approximately 17 per- 
cent of classroom time devoted to Discussion/Random as contrasted with 10 
percent reported by the Division of Teaching staff. The tendency for De- 
partmental Supervisors, as contrasted with Division of Teaching Super- 
visors, to report a larger proportion of time spent in this type of acti- 
vity obtains in both academic-type classes and laboratory-type classes. 

One explanation might be the highly technical meaning applied to Discussion/ 
Random. The Division of Teaching Supervisors participated in the develop- 
ment of TCA.P, the clarification of terms, training sessions, and trial runs. 
Inasmuch as the Departmental Supervisors had only limited training, it is 
likely that the more common connotation of the term "Discuss ion/Random" 
was used. 

An analysis of variance made of TCAP reports on laboratory-type 
classes and academic-type classes revealed a significant difference in 
the distribution of class time. The differences were significant at the 
.005 level for all categories except Recitation where it was significant 
at the .05 level and Management --Learning where there was no significant 
difference. 

As shown in Table 4.3, laboratory- type classes devote relatively 
more time to Management --NL and Discussion/Random than do academic- type 
classes. The data suggest, as one would expect, that it takes more time 
to organize equipment and distribute materials in laboratory classes than 
in academic classes. Music classes need to get instruments ready; phy- 
sical education classes require special clothing; science laboratories 
need to arrange their equipment. It seems a bit surprising that the dif- 
ference is not greater: 6.66 percent, or four minutes, of laboratory- 

class time as contrasted with 3.74 percent, or two minutes, of academic- 
class time. 

Again as one would expect, the data suggest that teachers in academic 
classes spend more time in Presentation--23.3 percent, or twelve minutes-- 
than do teachers in laboratory classes with 17.1 percent, or eight minutes. 
That the difference is not greater is due to the fact that when teachers 
talk to individuals or small groups in laboratory-type classes it is classi- 
fied as Presentation. 

The higher proportion of time spent in Recitation/Drill for labora- 
tory-type classes was probably due to the inclusion, by definition, of 
drill and practice in this category. 

The larger proportion of laboratory time spent in Discussion/Random 
probably reflects an accurate picture of irrelevant discussion and point- 
less talk. 

The data suggest, again as one would expect, that greater opportu- 
nities to participate in the higher levels of thinking and analysis arise 
in the academic classes. The 12.89 percent, or six minutes, and the 5.62 
percent, or three minutes, devoted to Logical Thinking in the respective 
types of classes are similarly disturbing because they represent such a 
small fraction of the total class time. 
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TABLE 4.4 



ANALYSIS OF VARIANCE ON DISTRIBUTION OF CLASSROOM TIME 
BY PERSON MAKING OBSERVATION AND BY TYPE OF CLASS 

A = Laboratory Class- -Academic Class 
B = Departmental Supervisor- -Staff Supervisor 



Time Category Source of 

Variance 



Management- -NL A 

B 

AB 

Error 

Management- -L A 

B 

AB 

Error 

Presentation A 

B 

AB 

Error 

Recitation/Drill A 

B 

AB 

Error 

Discussion/Random A 

B 

AB 

Error 

Logical Thinking A 

B 

AB 

Error 

Thinking Process A 

B 

AB 

Error 



DF 


MS 


F 


1 


1.43 


11.56*** 


1 


.02 


.20 


1 


.00 


.01 


1047 


.12 




1 


1.11 


1.20 


1 


.27 


.29 


1 


.36 


.39 


1047 


.92 




1 


15.85 


22 . 30*** 


1 


.91 


1.28 


1 


1.59 


2.23 


1047 


.71 




1 


3.50 


4.04* 


1 


3.17 


3.66 


1 


.80 


.92 


1047 


.87 




1 


27.37 


36.51*** 


1 


5.86 


7.81** 


1 


o01 


.01 


1047 


.75 




1 


3.06 


9 . 68*** 


1 


.01 


.04 


1 


3.84 


12.15*** 


1047 


.32 




1 


.325 


8.01*** 


1 


.01 


.28 


1 


.02 


.45 


1047 


.04 





* F(l, 1047 ;05) = 3.84 

** F(l, 1047 ;01) = 6.32 

*** F(l, 1047 ;005) = 7.88 
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An interesting relationship appears in the interaction analysis with 
respect to the Thinking category. When the academic and laboratory classes 
and the Departmental and Staff classifications are used, as reported in 
Table 4.4, only Logical Thinking shows any significance but does so 
at the .005 level. Figure 4.2 presents in graphic form the interaction 
effect with respect to Logical Thinking. 

FIGURE 4.2 

GEOMETRIC PROFILE OF INTERACTION BETWEEN 
TYPES OF OBSERVERS AND TYPES OF CLASSES ON 
LOGICAL THINKING CATEGORY 



Percent 

of 

Time 




A Types of Class B Types of Observers 

a-^ Laboratory b-^ Departmental 

a2 Academic b£ Staff 

Apparently Departmental Supervisors and Staff Supervisors do not 

perceive the Thinking category the same in laboratory- and academic- type 
classes. Departmental Supervisors tend to see more Thinking in labora- 
tory classes than in academic classes whereas the reverse is true for 
Staff Supervisors. 



One explanation for this variance could be that Departmental and 
Staff Observers interpreted the definition of Thinking differently. 

For laboratory -type classes time in which the teacher is actively in- 
volved in helping the students as they pursue their own purposeful 
activity is classified as Thinking. 

Another possible explanation could be that the subject-matter 
specialists who are the Departmental Observers tend to identify more 
Thinking in laboratory- type activity because of their special subject- 
matter orientation while on the other hand Staff Observers, who are 
generalists, are more comfortable in the academic classroom than in 
the more specialized laboratory. This is to say that a Music speci- 
alist in observing an orchestra rehearse tends to consider more re- 
hearsal time as belonging to the Thinking category. A Physical Educa- 
tion specialist considers the organized game as a Thinking experience 
or the Home Economics supervisor sees considerable Thinking as the 
girls bake the cake. 

The staff generalists apparently find it easier to identify Think- 
ing in the academic classes because they are more familiar with this 
type of class. If it were possible to pursue this question further 
some light might be cast upon the relative merits of supervision by 
generalists as opposed to subject-matter specialists. 

Examination of Table 4.5 shows the ways in which time distribu- 
tions vary with subject fields. It is interesting to note that the 
similarities far exceed the differences. While some variations do oc- 
cur, the main features of the profile present the same pattern in all 
subject fields. 

Art teachers spent considerably less time than the average teachers 
in Presentation and Logical Thinking and more time in Discussion/Random. 
Teachers of Business devoted more than average amounts of time to Manage- 
ment- -Learning and Discussion/Random but less to Presentation and Logical 
Thinking. Home Economics teachers differ from the average by spending 
more time in Presentation and Logical Thinking and less time in Recita- 
tion/Drill. Industrial Arts varies from the pattern primarily by de- 
voting less time to Recitation/Drill and Logical Thinking and more time 
lo Discussion/Random. Music teachers spend more time than average in 
Management- -Non-Learning and almost twice as much in Recitation/Drill, 
with less time in Discussion/Random and Logical Thinking. Physical 
Education teachers approximate the pattern except for a larger percentage 
of time in Management--Non-Learning and Recitation/Drill and a smaller 
percentage in Logical Thinking and the Thinking Process. English teachers 
devote more than average time to Management — Learning, Logical Thinking, 
and the Thinking Process and less time to Recitation/Drill and Discussion/ 
Random. Foreign Language teachers differ from the average by spending 
less time in both Management categories and Presentation (26 percent) and 
much more time in Recitation/Drill (44 percent). Social Studies teachers 
contrast with the average in greater time devoted to Presentation, Logi- 
cal Thinking, and the Thinking Process. Less time is spent in Recitation/ 
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TABLE 4.5 
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Drill and Discussion/Random. Mathematics teachers show the highest per- 
centage of time of any subject in Logical Thinking and Thinking Process 
with less time spent in Management --Learning, Recitation/Drill, and Dis- 
cussion/Random. Science teachers spend less time in Management --Learning, 
Recitation/Drill, and Discussion/Random but considerably more on Presenta- 
tion. Special Education teachers differ from the average primarily in the 
small amount of time devoted to Presentation and the large amount (52 per- 
cent) devoted to Recitation/Drill. 

The patterns of student teacher classroom activity were remarkably 
stable over time. Since the TCAP was discussed in considerable detail 
with the student teacher one could expect that there would be considerable 
change in the way the student spent his time between the first and second 
observations. From two to three weeks elapsed between the two observa- 
tions. Inasmuch as both students and supervisors expressed concern about 
the small proportion of time devoted to Logical Thinking and the Thinking 
Process, one would expect a marked increase in time spent in these acti- 
vities. Table 4.6 reveals that the patterns of teacher activity, on the 
average, were almost identical in the first and second observations. 



TABLE 4.6 



MEAN PERCENTAGES OF TIME 

DURING 


1 SPENT IN 
FIRST AND 

N = 


VARIOUS TYPES OF CLASSROOM ACTIVITY 
SECOND OBSERVATIONS 

* 563 


Category 


First 


Observation 


Second Observatioi 


Management- -Non- Learning 




4.71 


4.11 


Management- -Learning 




23.52 


21.31 


Presentation 




15.55 


16.30 


Recitation/Drill 




20.56 


20.78 


Discussion/Random 




7.90 


7.14 


Logical Thinking 




7.39 


7.78 


Thinking Process 




1.20 


1.42 



These data would tend to support Marie Hughes' conclusion that 
teachers' behavior patterns are stable through time.^ 



1 Marie Hughes, Development of the Means for Assessment of the 
Quality of Teaching in Elementary Schools (Salt Lake City: University 

of Utah Press, 1959). 
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Comparison with Other Research 

No comparable studies of teacher classroom behavior were found. 

B. 0. Smith's preliminary report on his study of logic summarizes the 
proportionate number of entries classified in each of his 13 categories 
for 17 different teachers for five consecutive class periods per teacher 
or a total of 85 classes, as shown in the following table. 



TABLE 4.7 

PROPORTION OF LOGICAL ENTRIES REPORTED BY SMITH 



Category 


Percent of Total 
Number of Entries 


Defining 


4.1 


Describing 


25.3 


Designating 


14.8 


Stating 


6.8 


Reporting 


2.9 


Substituting 


.3 


Valuating 


4 . S . 


Opining 


5.3 


Classifying 


3.0 


Comparing and Contrasting 


3.3 


Conditional Inferring 


7.3 


Explaining 


12.9 


Directing and Managing Classroom 


9.4 



While Smith's report does not purport to be a time study, the fact 
that only approximately 10 percent of the entries were classified as 
management and 90 percent as some type of logical operation makes one 
realize that there must be vast differences either in the classroom situ 
ations examined in the two studies or in the means of observing and/or 
reporting. It is recognized that Smith combined the teacher behaviors 
and students' behaviors while this study reported only teacher activity. 

This study fcund that approximately 25 percent of the time, as con- 
trasted with 10 percent of the entries in the Smith study, was spent in 
managing the classroom. Approximately an additional 15 percent of the 
time was spent in Discussion/Random- -a category which apparently has no 
counterpart in the Smith study. 

Smith's first four categories, which account for 53.9 percent of 
the entries, would likely be classified under Presentation and/or Reci- 
tation, which account for approximately 45 percent of the classroom time 



2 B. 0. Smith, A Study of the Logic of Teaching . US0E Project 
No. 258 (7257), Mimeographed (University of Illinois: Urbana, 1959). 
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Smith's next seven categories, which account for 36.7 percent of his en- 
tries, would be classified as Logical Thinking and the Thinking Process, 
which together consumed only 11 percent of the classroom time in this 
study. 

Regardless of whether or not these data are subject to any type of 
comparison, the staff is deeply concerned by the relatively small amount 
of time devoted to the third and fourth levels of intellectual activity. 

Marie Hughes suggests that the following range of percentages in 
each of the seven behavior categories produced the optimum interaction 
for learning in the elementary school: 3 



Controlling Functions 


20-40% 


Imposition 


1-3 % 


Facilitating 


5-15% 


Content Development 


20-40% 


Personal Response 


8-20% 


Positive Affectivity 


10-20% 


Negative Affectivity 


3-10% 



While this study was concerned only with secondary student teachers 
and the categories are not identical, it is interesting to see how the 
results might be compared with the time divisions recommended by Hughes, 
as shown in Table 4.8, which follows. 



TABLE 4.8 

COMPARISON OF PERCENTAGES OF TIME SPENT IN 
TCAP CATEGORIES AND HUGHES' CATEGORIES 



TCAP Categories % of Time 

Management --NL & L 27 

Presentation and 
Recitation/Drill 45 

Discussion/Random 16 

Logical Thinking 10 

Thinking Process 2 



Hughes' Categories % of Time 

Controlling 20-40 

Imposition 1-3 

Content Development 20-40 

Personal Response 8-20 

Positive Affectivity 10-20 

Negative Affectivity 3-10 



(Included in Content 
Development) 

Facilitating 5-15 



3 



Hughes, oj>. cit . 
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Conclusions 



The Teacher Classroom Activity Profile has proven to be an effec- 
tive instrument in the supervision of student teachers. Its use has 
enabled the supervisor and the student teacher to approach their con- 
ference on a more objective basis, looking at what the student teacher 
did rather than evaluating how well he did it. The evaluation is some- 
times entirely unnecessary or, rather, is self-evident once the super- 
visor and the student teacher agree on what the student teacher actually 
did. The use of the TCAP has also resulted in a shift in the pre- 
student-teaching orientation. Students are apprised of it and the 
importance attached to the last two categories is made clear. As a 
result, student teachers are beginning to plan their work so as to pay 
more attention to thinking. The questions they ask are of a higher 
order and recent observations suggest a marked increase in the propor- 
tion of time devoted to Logical Thinking and the Process of Thinking. 

The fact that student teachers devoted only ten percent of their 
class time to what is considered Thinking and only one percent to the 
Thinking Process has serious implications for their educators. This 
study did not examine certificated teachers. However, there is a sug- 
gestion that the differences in classroom behavior are not very great 
between student teachers and supervising teachers. Since supervising 
teachers, in the main, have not expressed concern about the way student 
teachers distribute their classroom activity, one might conclude that 
they are not disturbed by the small amount of time devoted to Thinking 
and the Thinking Process. 

This study does not presume to establish an ideal model of class- 
room behavior. Perhaps spending ten percent of class time in what has 
been defined as Thinking is all that can be expected. However, the lit- 
erature of education either explicitly or implicitly suggests that the 
chief function of the schools in a democracy is to improve the intellec- 
tual ability of the people. The data presented here suggest that student 
teachers either reject this purpose in favor of doing other things or are 
not prepared to help students learn to think, or the concept of Thinking 
and the Thinking Process as formulated for this study needs further re- 
finement before it becomes a meaningful construct. The staff is con- 
vinced that teacher educators need to come to grips with this problem 
even though it presents great difficulties. 
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CHAPTER V 



ANALYSIS OF THE SECONDARY STUDENT TEACHER PERFORMANCE PROFILE (SSTPP) 



Beginning in the fall of 1966, all staff members of the Division of 
Teaching used the Secondary Student Teacher Performance Profile (SSTPP) 
together with the Guide as a regular part of the supervisory process. The 
staff also used it under five experimental conditions as reported in Chap- 
ter III. The data examined in this chapter are drawn from a three-year 
period. Since the other data with which comparisons were made were not 
universally available, special care has been taken to report the number 
of students involved in each analysis. 

Three sources of data were used. The first was that available from 
the regular university records--cumulative grade-point average, scores 
on the Scholastic Aptitude Test taken as a freshman, and estimated grade- 
point average computed from SAT scores and rank in high school class. A 
second source consisted of examinations administered as a part of this 
research--Cattell ' s The Sixteen Personality Factor Questionnaire, Form A 
and the Cornell Test of Critical Thinking, Form Z, by Robert Ennis.* The 
third source of data was reports by university personnel--assessments 
made by Division of Teaching staff in preliminary interviews, assessments 
made by Departmental Supervisors in preliminary interviews, and evalua- 
tions made by the cooperating teachers at the end of the student teaching 
period. 

The experimental group consisted of 564 individual secondary student 
teachers selected at random from those assigned during the academic years 
1966-67 and 1967-68. The total group included, in addition to the ex- 
perimental group, 243 student teachers from the years 1966-68 and 264 
from the year 1965-66. 



The Observers 



Figure 5.1 presents in graphic form a summary of criterion scores 
assigned by the twelve different staff observers who worked with the 
project at one time or another, in 2,018 classroom observations. 

Figure 5.1 shows, for example, on Criterion I (Understanding, Friendly 
vs. Egocentric, Aloof) the mean estimate given all student teachers ob- 
served by the twelve staff members was 2.63, with a standard deviation of 
1.05. The mean estimate in 1000 observations of the 564 students in the 
experimental group was 2.73 with a standard deviation of 1.02. The mean 



*Plans to administer the National Teacher Examination were abandoned 
when students failed to volunteer to take the examination even though it 
was offered at no financial cost to them. The students were forced to 
take the 16 PF test and the Cornell test. It is possible that their scores 
on these tests could have been distorted by their attitude toward being 
required to take them. 
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MEANS, STANDARD DEVIATIONS, AND RANGES OF CRITERION ESTIMATES 
MADE BY TWELVE OBSERVERS FOR TOTAL GROUP AND EXPERIMENTAL GROUP 
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estimates made by all twelve staff members on Criterion I ranged from 
2.12 to 3.11. The mean estimate assigned to all criteria on all ob- 
servations was 3.01. It should be kept in mind that the most favorable 
rating was 1 and the least favorable 7. 

The mean estimates and standard deviations are similar for the total 
group and for the experimental group. 

It is apparent that the cultural bias toward generosity of ratings 
so prevalent in America moved the midpoint approximately one unit higher 
than the midpoint of a seven-point scale.* This J effect applies to all 
criteria except VII and VIII, which are concerned with logic. 

Figure 5.1 illustrates by a different treatment of the data several 
conclusions reported in Chapter III. Staff supervisors tended to agree 
most closely with respect to Criteria III (Stimulating, Imaginative, 
Surgent vs. Dull, Routine, Unimaginative) and VI (Communicates Well and 
Empathetically vs. Communicates Ineffectively and Perfunctorily). They 
tended to vary the most on Criteria VII (Classroom Discourse Characterized 
by Reasoning and Creative Thinking vs. Classroom Discourse Characterized 
by Simple Recall) and VIII (Directs Attention to Process of Thinking vs. 
Fails to Call Attention to Process of Thinking). They tended to rate 
student teachers most favorably on Criterion II (Planned, Organized, Re- 
sponsible vs. Unplanned, Disorganized, Irresponsible). Similar favorable 
ratings were given on Criteria I (Understanding, Friendly vs. Egocentric, 
Aloof), IV (Perceives Self as Competent vs. Perceives Self as Less Than 
Adequate), V (Has Mastery of Facts and Organizing Principles of Field 
vs. Has Only Minimum Knowledge of Field) and IX (High Professional Po- 
tential vs. Low Professional* Potential) . Less favorable ratings were 
given on Criteria VI (Communicates Well and Empathetically vs. Communi- 
cates Ineffectively and Perfunctorily) and III (Stimulating, Imaginative, 
Surgent vs. Dull, Routine, Unimaginative). Student teachers were rated 
most unfavorably on Criterion VIII (Directs Attention to Process of 
Thinking vs. Fails to Call Attention to Process of Thinking) and Cri- 
terion VII (Classroom Discourse Characterized by Reasoning or Creative 
Thinking vs. Classroom Discourse Characterized by Simple Recall). 



* The Stanford Teacher Competence Appraisal Guide which used a 
seven-point scale was arranged to reduce the J-curve effect and over- 
come the generosity factor by designating 3 as the average. It also 
indicated a percentage figure and a name for each point on the scale, 
as follows: 1 = Weak, 30%; 2 = Below Average, 15%; 3 = Average, 15%; 

4 = Strong, 15%; 5 = Superior, 15%; 6 = Outstanding, and 7 = Truly 
Exceptional, 10%. No percentages were given and no names were assigned 
to the seven points of the scale in this study. Only the two extremes 
were identified. 

R. N. Bush, et a_l . , oj>. cit . , p. 5. 
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Table 5.1 presents the mean estimates on each criterion by observer. 
For example, it shows that Observer 12 reported 290 observations with an 
average rating on Criterion I of 2.46 and a standard deviation of .98. 

While it is possible that the students observed by different members 
of the staff did vary on the criteria it is likely that personal bias of 
observers accounted for much of the variation shown. This bias seems to 
persist in spite of intensive observation training sessions. For ex- 
ample, Observers 12, 14, 15, and 24 tended to rate students higher on 
Criterion I (Understanding, Friendly vs. Egocentric, Aloof) than did 
Observers 13, 16, and 19. Observer 19 tended to rate students lower on 
all the criteria relating to personality than did other observers. Ob- 
servers 13 and 14 tended to rate students lower on the criterion related 
to logic. 

Brown examined this problem and concluded: "In order to understand 

what any given observer- judge means when he says, 'This is a good teacher,' 
or, 'This is a poor teacher,' we must know who the observer-judge is, what 
he values, and where he stands on important educational issues when he ob- 
serves and judges."^- 

This study was designed to handle the problem of observer bias in 
two ways--first, by randomization of assignment and, second, by training. 
No provisions were made to isolate and correct for observer bias. 

A preliminary investigation using factor analysis suggested that it 
would be possible to identify observer bias and determine a correction 
index. Such an investigation was beyond the purview of this study. 



Platoons and Semesters 



A special analysis was made of criterion ratings to see if any 
variation occurred between first and second platoon student teachers 
or between semesters. All ratings of "N" (not sufficient evidence) 
were deleted from the analysis. Figure 5.2 presents in graphic and 
tabular form the means and standard deviations of ratings on the nine 
original criteria and the three composite criteria. Table 5.2 pre- 
sents the analysis of variance due to platoons and semesters. 

No significant variation occurred between the two platoons on 
any of the criteria. Inasmuch as Platoon I students have not taken 
the related Education courses nor Special Methods courses prior to 
student teaching while Platoon II students have completed these courses 
prior to their assignment, one might expect some differences in cri- 



l-Bob Burton Brown, "Observer- Judge Ratings of Teacher Competence," 
Childhood Education. Vol. 44 (November, 1967), p. 205. 
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terion estimates. However, this finding is consistent with other 
studies which have shown no significant differences between the two 
platoons /• 

A slight variance, significant at the .05 level, occurred with 
respect to Criterion VIII by semesters. Examination of Figure 5.2 
shows a step-wise improvement in the ratings assigned on Criterion 
VIII over the last three semesters. One explanation could be that 
student teachers became aware of the value attached to this criterion 
even though no special effort was made to instruct them. Another 
explanation could be that the Supervisors through experience and in- 
service training sessions, became more expert in identifying class- 
room behavior which directed pupils' attention to the thinking process. 

The tabular information presented below Figure 5.2 shows that the 
most "N" (not-suf f icient data) responses were made on Criteria VII and 
VIII, even through the last semester. For example in platoon 74, 
which was the fourth platoon of the year 1967-68, 81 ratings were made 
on Criteria I, II, III, VI, and IX, while only 68 ratings were made on 
Criterion VII, 58 on Criterion VIII, and one "N" was marked on Criterion 
V. 



The number of subjects included in the composite criteria was sub- 
stantially lower than the total students studied because only those 
students who had been rated on all criteria were included. 



2Marvin A. Henry, The Relationship of Difficulties of Teachers 
to Selected Aspects of the Professional Sequence of Education (Un- 
published doctoral dissertation. Bloomington, Indiana: Indiana Uni- 
versity, June, 1963). 
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TABLE 5.2 



ANALYSIS OF VARIANCE OF CRITERION 
RATINGS BY SEMESTER AND BY PLATOON 



A = Semester 
B = Platoon 





Criterion 


Source of 
Variance 


DF 


MS 


F 


I. 


Understanding, 


A 


3 


.54 


.50 




Friendly 


B 


1 


.98 


.92 






AB 


3 


2.19 


2.05 






Error 


192 


1.07 




II. 


Planned , 


A 


3 


1.77 


1.61 




Organized 


B 


1 


0.00 


0.00 






AB 


3 


.51 


.46 






Error 


192 


1.10 




II. 


Stimulating 


A 


3 


3.25 


1.98 






B 


1 


1.00 


. 61 






AB 


3 


2.47 


1.51 






Error 


192 


1.64 




IV. 


Self Concept 


A 


3 


2.34 


1.73 






B 


1 


.14 


.10 






AB 


3 


1.21 


.90 






Error 


192 


1.35 




V. 


Subject Mastery 


A 


3 


2.39 


1.84 






B 


1 


.60 


.46 






AB 


3 


.55 


.42 






Error 


192 


1.30 




VI. 


Communication 


A 


3 


1.03 


.69 






B 


1 


.01 


.01 






AB 


3 


1.04 


.69 






Error 


192 


1.50 
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TABLE 5.2 
(continued) 



Criterion Source of 

Variance 



DF MS F 



VII. Reasoning A 

B 

AB 

Error 

VIII. Process of A 

Thinking B 

AB 

Error 

IX. High Potential A 

B 

AB 

Error 



X. Composite A 

Personality B 

AB 

Error 

XI. Composite A 

Logic B 

AB 

Error 

XII. Composite A 

Organization B 

AB 

Error 



*F(3, 192.05) = 2.65 



3 

1 

3 

192 

3 

1 

3 

192 

3 

1 

3 

192 

3 

1 

3 

192 

3 

1 

3 

192 

3 

1 

3 

192 



3.49 


1.56 


7.22 


3.24 


1.19 


.53 


2.23 


11.71 


3.61* 


.04 


.01 


2.93 


.90 


3.24 


.45 


.32 


.64 


.46 


.56 


.40 


1.40 


1.26 


1.40 


.47 


.52 


1.31 


1.46 


.90 


1.66 


2.27 


.71 


.97 


.42 


.58 


.73 


.24 


.67 


.00 


.00 


.07 


.19 


.36 
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Subject Fields 



Table 5.3 presents the mean criterion ratings assigned to student 
teachers in the various teaching fields and by type of class. For ex- 
ample, of 257 student teachers observed teaching English a mean rating 
of 2.58 was given in Criterion IX (High Professional Potential vs. Low 
Professional Potential). This compares favorably with an overall mean 
of 2.71 and a mean of 2.67 for all academic- type classes. Only Special 
Education student teachers were rated higher--2.50. 

The high degree of similarity among the means assigned on all cri- 
teria regardless of the subject field can be seen. It should also be 
noted that there is practically no difference in the means assigned to 
laboratory-type classes and to academic-type classes. By observation 
it can be seen that the standard deviation is usually at least twice as 
large as the greatest difference between any means for a given criterion. 

Student teachers in Mathematics, followed by those in English, Music, 
Art, and Special Education ranked highest on Criterion VII (Classroom 
Discourse Characterized by Reasoning or Creative Thinking). Music, 

Special Education, and Mathematics teachers were rated highest on Cri- 
terion VIII (Directs Attention to Process of Thinking). Foreign Lan- 
guage students received the highest ratings and Social Studies the lowest 
on Criterion V (Has Mastery of Facts and Organizing Principles of Field). 

On Criterion I (Understanding, Friendly), Industrial Education, 
Science, and Social Studies student teachers were rated lower than others. 
Special Education teachers were rated the highest. On Criterion II 
(Planned, Organized, Responsible), student teachers of Business, Foreign 
Language, and Special Education were rated highest. On Criterion III 
(Stimulating, Imaginative, Surgent), student teachers of Foreigh Lan- 
guage, Special Education, and English were rated the highest while In- 
dustrial Education and Home Economics were ranked the lowest. It should 
be noted that the difference between laboratory-type classes and academic- 
type classes was the greatest on this criterion. 

On Criterion IV (Perceives Self as Competent), the highest ratings 
were given in Foreign Language and Mathematics and the lowest in Indus- 
trial Education, Home Economics, and Social Studies. 

On Criterion VI (Communicates Well and Empathetically) , student 
teachers in Special Education, Foreign Language, and English rank highest 
with those in Industrial Education, Science, Social Studies and Physical 
Education lowest. 

The differences on criterion ratings were so small among the various 
subject fields that it is not practical to generalize about a specific 
subject field. 
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Factor Analysis of SSTPP Ratings 



When the criteria were identified it was assumed that there were 
eight discrete areas of professional behavior and one overarching cri- 
terion. Factor analysis using oblique as well as orthogonal matrices 
revealed only three factors among the nine criteria. The first might 
be called a personality factor which loaded from Criteria III, VI, I, 
and IV. The second could be called the logic factor and loaded from 
Criteria VII and VIII. The third factor could be called organization- 
loaded from Criteria II and V. The first factor (Personality--subse- 
quently referred to as Criterion X) accounted for 63% of the variance, 
while the second factor (Logic-referred to as Criterion XI) accounted 
for 32% of the variance and the third factor (Organization— Criterion 
XII) accounted for 13% of the variance. Factor scores were computed 
for each student teacher and are examined in the following sections of 
this report along with the original nine criteria. 



Relationship to Cumulative Grade-Point Average 

As shown in Table 5.4, of the 564 student teachers in the study 
only 510 had cumulative grade-point averages with which to correlate 
their criterion scores. While correlations for all criteria except VII 
and VIII are significantly different from zero, they are so small as to 
be of little practical value for predictive purposes. 

Criterion V (Subject Matter) with an r of .26 is the highest. Cri- 
terion VI (Communication) is next with an r of .25 followed by the global 
estimate Criterion IX with an r of .22. Criterion II (Organization), IV 
(Self-Concept) and III (Surgency) have r's of .17, .16, and .13 respec- 
tively. It should be noted that Criteria VII and VIII have no relation- 
ship while that for Criterion I (Friendliness) has an r of only .06. 

Of the three factor scores, Criterion XII (Composite Organization) 
correlated the highest with an r of .20, followed by Criterion XI (Com- 
posite Logic) with an r of .12 and Criterion X (Composite Personality) 
with an r of . 11 . 

It is obvious that the criterion estimates are measuring something 
other than what is measured by academic grades. However, it is inter- 
esting that the highest correlations are with Criterion V which rates 
the student teacher's mastery of his subject field and Criterion VI which 
rates the student teacher's communicative skills. The criteria concerned 
with Logic, VII and VIII, pose a serious problem of interpretation. Those 
students who were rated highest on these criteria were not the "best" aca- 
demic students— a point which was mentioned in staff meetings as the staff 
refined its definitions. That Criteria VII and VIII played a relatively 
minor role in determining the global rating on Criterion IX is shown by 
the relatively low correlations between Criterion IX and Criteria VII and 
VIII as reported in Table 5.5. 
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TABLE 5.5 



MATRIX OF CORRELATION COEFFICIENTS -CRITERION IX 
(HIGH PROFESSIONAL POTENTIAL) AND OTHER CRITERIA 

N = 499 Observations 



Criterion 


Criterion IX 


I 


.664 


II 


.731 


III 


.747 


IV 


.617 


V 


.736 


VI 


.766 


VII 


.283 


VIII 


.278 


IX 


1.000 



It is possible that the concept of Thinking which the staff developed 
and attempted to apply in Criteria VII and VIII is so narrowly conceived 
as to be unrelated to other qualities or so poorly defined as to be im- 
practical. Or it is possible that the concept of Thinking and the Thinking 
Process is one that should be identified as a distinct pedagogical skill. 

In spite of the difficulties encountered in handling this element of 
teacher behavior the staff is unanimous in its belief that it is important, 
and is continuing to experiment with observation and reporting techniques. 



Relationship to Estimated Grade-Point Average 

The estimated grade-point average, computed by the university admis- 
sions office for the assistance of counselors, uses scores on the Scholastic 
Aptitude Test and rank in high school graduating class. Correlations be- 
tween criterion ratings and estimated grade-point average, like those with 
actual cumulative grade-point average, are statistically significant but 
are so low as to have little predictive value. As shown in Table 5.4, 
interestingly, Criterion XI (Composite Logic) has the highest correlation, 
r = .22, while Criterion IV (Self-Concept) has a low of r = .04. Except 
for Logic, the correlations are similar to those found for cumulative 
grade -point average. 
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Relationship to Scores on Scholastic Aptitude Test 

The fact that criterion assessments fail to show any relationship 
whatsoever with scores on the SAT tests must be viewed as significant. 

If one assumes that the SAT test gives a reasonable estimate of a stu- 
dent's verbal and mathematical abilities it is apparent that these same 
abilities did not play an important role in influencing the observer's 
judgment. The SSTPP criterion scores reflect something other than these 
abilities. The slight positive correlations on the Global Criterion IX 
suggest that generalized ability as perceived by the observer plays a 
more important part in making the global estimate than in making esti- 
mates on the other discrete criteria. 

Criterion XI (Composite Logic) which correlates with SAT Mathe- 
matics score at .12 and the fact that Mathematics teachers obtained the 
highest score on Criterion VII (Reasoning) as reported in Table 5.3 
suggest some relationship between mathematical ability and the use of 
Logic in the classroom. 



Relationship to the Cornell Critical Thinking Test 

The Cornell Critical Thinking Test was selected because its author 
had been associated with the University of Illinois group under the leader- 
ship of B. Othanel Smith concerned with studying logic and teaching. 3 A 
distribution of raw scores is included as Figure 5.3. 

The correlations between scores on the Cornell Critical Thinking Test 
and criterion estimates as presented in Table 5.4 are so low as to be of 
no significance. It had been hypothesized that student teachers who were 
rated high on Criterion VII (Classroom Discourse Characterized by Reason- 
ing or Creative Thinking) and Criterion VIII (Directs Attention to Pro- 
cess of Thinking) and on Criterion XI (Composite Logic) would score high 
on the Critical Thinking Test. The hypothesis had to be rejected be- 
cause none of the correlation coefficients were significantly different 
from zero. Apparently SSTPP scores even on criteria related to logic re- 
flect some other quality than that measured by the Cornell test. 

It is interesting to note that almost the same absence of relation- 
ship exists with respect to SAT scores and criterion estimates. 

The scores on the Cornell Critical Thinking Test positively corre- 
lated with cumulative grade-point average, r = .35 (N = 290) and scores 
on the Scholastic Aptitude Test, r - .18 for the Verbal Test and r = .19 
for the Mathematics Test (N = 265).* * 



3Robert H. Ennis, The Development of a Critical Thinking Test . Ph.D. 
Dissertation, University of Illinois, 1958 (University Microfilms, Inc., 
Ann Arbor, 1962), p. 156. 

*See the Master Matrix of Correlation Coefficients between Assess- 
ments on the Twelve Criteria and Other Variables. Appendix D. 
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Mean = 17.69 Standard Deviation = 7.32 Number = 836 

Skewness, which describes the degree of asymmetry of a distribution, = 6.128. 

Kurtosis, which describes the relative flatness or peakedness of a distribution = 10.816 
Score = Rights minus one-half wrongs. 




Only two significant correlations appear between scores on the CCTT 
and the 16 PF test. A positive r .24 was obtained on Factor B— General 
Intelligence, Bright and a negative r -.13 was obtained on Factor H-- 
Adventurous vs. Shy* Timid. Both of these correlations were significantly 
different from zero at the .01 level. This adds a bit more evidence that 
student teachers who score high on Criteria VII and VIII fit the stereotype 
of the quiet, timid intellectual. 

It seems strange that no significant relationships were found between 
scores on the CCTI and the time distribution reported in TCAP. Although 
the highest correlation (r = .09) was found between CCTT and the amount 
of time devoted to the Thinking Process and the next highest (r ■ .07) 
between CCTT and time devoted to Logical Thinking, these relationships 
failed to be of statistical significance. Similarly, scores on the CCTT 
were not related to evaluations made by cooperating teachers. 

Further study of the CCTT is necessary before its value in a teacher 
education program can be determined. 



Relationship to Evaluation by Supervising Teachers 

Student teachers at Indiana State University are not assigned letter 
grades. The official transcript reports credit or no credit. Each super- 
vising teacher or cooperating teacher does complete an evaluation form 
which includes a check list of twenty-two items plus three open-ended 
statements, and a summary evaluation as follows: "In my judgment this 

student will become a teacher who is (check one only) Outstanding, Above 
Average, Average, or Below Average." 

Correlations between ratings so given by cooperating teacher and 
criterion scores assigned by Division of Teaching staff members are shown 
in Table 5.4. 

It should be noted that these are the highest correlations obtained 
in any comparisons. With the exception of the criteria concerned with 
logic, the correlations are not only significantly different from zero 
but have some moderated predictive value in at least two instances. 

A correlation coefficient of .44 between Criterion IX (Professional 
Potential) and the supervisors' estimate of the students' future success 
bespeaks some agreement among evaluators. Criterion X (Composite Per- 
sonality) which correlates at the .40 level with supervising teachers' 
judgment suggests that personality does play a most important role in 
teacher evaluation. This point is also supported by the r of .37 which 
shows the relationship between scores on Criterion IV (Perceives Self 
as Competent) and cooperating teachers' judgments. 

Criterion XII (Composite Organization) plays an important role in 
supervising teachers' judgments as shown by r of .37 for Criterion XII 
which is made up of Criterion II (Organized, Planned) with an r of .32 
and Criterion V (Mastery of Subject Matter) with an r of .33. 

Again, the criteria concerned with Thinking and Logic fail to show 
any relationships. 
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The fact that criterion scores do correlate at a moderate level with 
estimates made by cooperating teachers whereas they fail to correlate with 
other descriptive data suggests that the criterion scores are reflecting 
some specific skills or competencies which could be identified as peda- 
gogical or teaching behaviors and are similar to the qualities identified 
by cooperating teachers. 

In a pilot study conducted in 1964, as reported in Table 5.4, co- 
operating teachers' evaluations were correlated with the ratings on SSTPP. 
These coefficients are very similar to those obtained in the study proper 
on Criteria II, III, IV, V, and IX. In the pilot study, Criterion VI 
(Communication) had a low correlation, r = .05, while Criteria VII and 
VIII (Logic) had relatively high correlations, r = .26 and .35. No ex- 
planation of the low correlation on communication is apparent. The sur- 
prisingly high correlations on the logic criteria are probably due to the 
fact that the staff was involved in designing the instrument and writing 
the Guide at that time. In the process of identifying student teacher 
behaviors the students and their cooperating teachers were consulted. 

There was likely an unconscious tendency to "teach" for high performance 
on Criteria VII and VIII. During the two years of the project super- 
visors avoided any action which would encourage students to strive for 
a special rating on SSTPP. While the TCAP observation was discussed 
with students, the ratings on SSTPP were not. 

Similar results were obtained in a small project described as Treat- 
ment 5 in Chapter III. During a summer session when supervisors actually 
taught Education courses to the students they supervised, improvement in 
both student performance and observer evaluation occurred on Criteria 
VII and VIII. 

While it had been hoped that the careful definition of the criteria 
in terms of teaching behavior and controlled methods of observation would 
result in estimates which would be related to other data commonly used to 
predict teacher performance, the results failed to reveal any such re- 
lationship . 



Relationship to Sixteen Personality Factor Questionnaire 

As shown in Figure 5.4, the two profiles made by the mean scores on 
the 16 PF Questionnaire are almost identical between the Experimental 
Group and student teachers not included in the Experimental Group. Both 
groups are slightly above the mean on Factors B, C, G, Q], and Q3 and lower 
on the second order factor of Anxiety. With respect to the other factors 
the means fall within the interval between Sten 5 and Sten 6 which by defi 
nition includes scores one-half of a standard deviation below and above 
the mean. 

The profile differs from that provided by R. B. Cattell for 1128 col- 
lege undergraduates. These undergraduates were considerably higher on 
Factors A, C, D, and H and lower on Factors G, Qi, and Q2 than either of 
the student teacher groups at Indiana State University. 
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Supplementation, p.28. 



CORRELATION COEFFICIENTS OF CRITERIA RATINGS 
AND SCORES ON THE SIXTEEN PERSONALITY FACTOR QUESTIONNAIRE 
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VI. Communication 
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VIII. Process of Thinking 

IX. Professional 
Potential 

X. Composite Personality 

XI. Composite Logic 

XII. Composite 

Organization 
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One of the contributing factors to the low correlations between 
SSTPP criterion ratings and scores on the 16 PF test is the tendency 
of scores on the 16 PF to cluster close to the mean. 

The similarity of several terms used in the SSTPP and the 16 PF 
Questionnaire suggested possible relationships. For example, Criter- 
ion I was defined as Understanding, Friendly vs. Egocentric, Aloof 
which would appear to compare with Factor A which is described as Cyclo- 
thymia (Warm, Sociable) vs. Schizothymia (Aloof, Stiff). 

Criterion II, which was defined as Planned, Organized, Responsible 
vs. Unplanned, Disorganized, Irresponsible, would seem to compare with 
Factor G-- Conscientious , Persistent vs. Casual, Undependable. Cri- 
terion III (Stimulating, Imaginative, Surgentvs. Dull, Routine, Unima- 
ginative) would seem to compare with Factor F--Surgency--Enthusiastic, 
Happy-Go-Lucky vs. Desurgency--Glum, Sober, Serious, and Factor H-- 
Adventurous- -Active, Responsive, Genial vs. Shy, Timid. Criterion IV 
(Perceives Self as Competent vs. Perceives Self as Less than Adequate) 
would appear to have some things in common with Factor C — Emotional 
Stability or Ego Strength and Factor H- -Adventurous vs. Shy, Timid and 
Q 2 “ -Self-Sufficiency. 

The factor analyses made of the nine criteria identified one major 
factor which was called Criterion X (Composite Personality) and two minor 
factors, Criterion XI (Composite Logic) and Criterion XII (Composite 
Organization). One might expect the criteria which loaded the Composite 
Personality Factor, namely I, III, IV, VI and IX, to be related to scores 
on the 16 Personality Factor Test. 

It was hypothesized that high criterion ratings would correlate with 
similarly high scores on the comparable 16 PF Questionnaires. 

As a matter of fact, many correlations were found to be signifi- 
cantly greater than zero but none of them were high enough to be useful 
as predictors. They do suggest a possible relationship and argue for 
further study. It should be kept in mind that the criteria were conceived 
of as performance criteria rather than personality criteria. Observers 
made their estimates on the basis of what the teacher did rather than 
what the teacher "was." The criteria reflect a theory of teaching while 
the 16 PF scores reflect a theory of personality. 

Criterion I (Understanding, Friendly) as shown in Table 5.6 corre- 
lated not with Factor A but slightly significantly at the .05 level with 
Factor C, r = .10; Factor G, r = .09; Factor H, r = .09; and with the 
second order factor of Anxiety, r = -.10.* An examination of the glossary 
of Operational Definitions for SSTPP and the illustrative anecdotal reports 



* A two-tailed test of correlation coefficent being significantly 
different from zero requires r>.088 at the .05 level and r>.115 at the 
.01 level. 
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would explain the relationship of Criterion I and Factors C, G, H, and 
Anxiety, as follows: the student teacher who scores high on Criterion I 
is Attentive to People (G), Friendly rather than Shy, Withdrawn, or Aloof 
(H), and low on the second-order factor. Anxiety. The concept of Emotional 
Stability, Mature and Calm, which described Factor C, does not appear in 
any definitions of Criterion I. 

Criterion II (Planned, Organized, Responsible) did correlate, r = .16, 
with Factor G--Conscientious which is significant at the .01 level. Simi- 
lar relationships are suggested with Factors C- -Emotional Stability, r = .16; 
0- -Confidence, r = .11; (^--Controlled, r = .11; and Qa — T ense, r = .14; and 
the second-order factor of Anxiety where a negative relationship, r = -.17, 
was found. A correlation significant at the .05 level was found with Factor 
H- -Adventurous, r = .08. 

Descriptive data for Criterion II emphasized the planning and organ- 
izing ability of the student which does include the conscientiousness of 
Factor G. It is interesting that other factors are related to Criterion II 
scores, in the same degree: Factor C — Emotional Maturity; the second-order 

factor- -Anxiety ; Factor 0-- Self -Confidence as contrasted with Timidity; 

Factor Q3-- Control led; and Q4--Tense. These may contribute to the judgments 
given but they were not anticipated. 

Criterion III (Stimulating, Imaginative, Surgent vs. Dull, Routine, 
Unimaginative) failed to relate significantly to Factor F--Surgency by a 
small amount, r = .082, while an r of .088 was required for significance 
at .05 level. However, it was related to Factors H- -Adventurous, r = .24; 
E--Dominance, r = .17; and C--Ego Strength, r = .16. Student teachers who 
were rated high on Criterion III (Stimulating, Imaginative, Surgent) re- 
ceived significant scores on both second-order factors. For Anxiety the 
relationship was negative, r =-.14; for Extroversion it was positive, r = .18. 

On Criterion IV (Perceives Self as Competent vs. Perceives Self as Less 
than Adequate) the observers were rating a generalized personality trait 
rather than a pedagogical skill. The ratings were significantly related 
at the .01 level on nine of the eighteen factors. Student teachers who were 
rated high on self-concept scored high on Factors H- -Adventurous, r = .21; 

E - -Dominance , r = .17; G--Conscient ious, r = .16; 0--Timid, r = -.15; C — 

Ego Strength, r = .14; I — Sensitivity, r = .10; F — Surgency, r = .10; 

Anxiety, r = .17; and Extroversion, r = .19. 

Criterion V (Has Mastery of Facts and Organizing Principles of Field 
vs. Has Only Minimum Knowledge of Field) was not considered a personality 
criterion. However, it was related to six of the factor scores at the .01 
level and two at the .05 level. Student teachers who were rated high in 
subject mastery tend to rate low in Anxiety, r =-.15 and Factor 0--Timid, 
r = -.11, and high in Factor G- -Conscientious, r = .16; C--Ego Strength, 
r = .13; H- -Adventurous, r = .13; and Q4— High Tension, r = .12. At the 
.05 level they were Q3-- Control led, r = .10 and Extroverted, r = .09. 
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Criterion VI (Communicates Well and Empathetically vs. Communicates 
Ineffectively and Perfunctorily) was related at the .01 level to Factor 
H- -Adventurous, r = .19; Extroversion, r = .18; E--Dominance, r = .17; 
C--Ego Strength, r = .17; and Anxiety, r =-.16. At the .05 level com- 
munication skill seemed to be related to (^--Controlled, r = .11; G-- 
Conscientious, r = .11; Q4--High Tension, and 0--Timid, r = -.10. 

Criterion VII (Classroom Discourse Characterized by Reasoning or 
Creative Thinking vs. Classroom Discourse Characterized by Simple Recall) 
is related negatively to three personality factors: A--Warm, Sociable, 

r = -.13; F--Surgency, r = -.11; and Extroversion-Introversion, r = -.11. 
Apparently the concept that students who rate high on reason and logic 
have to be cold, unexciting, and introverted persists in the rating of 
student teachers. 

Criterion VIII (Directs Attention to the Process of Thinking vs. 

Fails to Call Attention to the Process of Thinking) is similarly nega- 
tively related to Factor F--Surgence, r = -.14 and Extroversion, r = -.11. 
However, it is positively related to G--Conscientious, r = .14. 

Criterion IX (High Professional Potential vs. Low Professional Po- 
tential) is related to seven factors: Anxiety, r =-.17; H- -Adventurous, 

r = .15; C- -Ego Strength, r = .15; Q^--High Tension, r = -.14; G- -Con- 
scientious , r = .13; (^--Controlled, r = .12; and Extroversion, r = .11. 

Criterion X (Composite Personality) is related to Factors C--Ego 
Strength, r = .14; E--Dominance , r = .14; (^--Controlled, r = .15; Extro- 
version, r = .19; and Anxiety, r = -.17. 

Criterion XI (Composite Logic) is negatively related to Factor A-- 
Warm, Sociable, r = -.17 and Factor N--Sophisticated, r = -.10, and 
positively related to Q 2 --Self-Suf f icient , r = .11. 

Criterion XII (Composite Organization) is related to Factors G-- 
Conscientious, r = .13 and (^--Controlled, r = .13. 

Because the 18 separate factors had only a low correlation to the 
criterion scores, a multiple regression analysis was run on the 16 PF 
scores. Table 5.6 includes in the right-hand column the values of the 
multiple r plus the corresponding F values. The multiple r was related 
at the .01 level to Criteria III, IV, VI, and VIII. It was related at 
the .05 level to Criteria V, IX, and XI. 

In summary, the relationships between criteria estimates and scores 
on the 16 PF test are statistically significant. It must be pointed out 
that the correlations are of such a low value that their usefulness as 
predictors is not very great. However, it must also be recognized that 
the relationships are all consistent with the theoretical constructs 
of the two instruments. While the evidence may not be conclusive, there 
is certainly a strong suggestion that the criteria are not inconsistent 
with some scores on the 16 PF Questionnaire. 







Relationships Between Assessments Made on an Initial 
Interview and Those Made from Classroom Observations 

Prior to assigning a student teacher to a cooperating school , per- 
sonal interviews were conducted by staff members and Departmental Super- 
visors. The actual assignment was decided upon in a joint conference of 
staff and Departmental members. For purposes of this study the staff 
members made an estimate of the student's future performance on the nine 
criteria. For one semester Departmental Supervisors estimated the stu- 
dent's performance on the global Criterion IX. 

Approximately 30 minutes were devoted to the interview in which the 
staff member reviewed the student's written application, his college re- 
cord and a four-page personal data sheet reporting the student's back- 
ground, his non-school experiences, his interests and his aspirations. 
Considerable time was devoted to exploring the type of school and teacher 
to which the student should be assigned. While some attention was given 
to university policies regarding assignments, the interview was structured 
to enable the staff member to become acquainted with the student. 

At the end of the interview, the student's predicted performance on 
each of the nine criteria was recorded using the seven-point scale. All 
assessments were made without reference to any previous ratings. 

Five hypotheses were posed with respect to the interview: 

First, ratings based on the interview would correlate with 
subsequent ratings based on observed classroom behavior. 

Second, the interview itself would provide clues from which 
to predict the student's ratings on Criteria I (Friendliness), 
III (Surgence), and IV (Self-Concept) and the predictions 
would yield the highest correlations. 

Third, clues could be obtained from the student's records 
and the information he provided which would result in 
reliable predictions for Criteria II (Organization) and 
V (Subject Matter). 

Fourth, the lowest correlations would be found on Cri- 
teria VII (Logic) and VIII (the Thinking Process). 

Fifth, the correlations would be higher when the inter- 
view and the observation were performed by the same person. 

Table 5.7 reports the correlations among the criteria ratings made 
in the initial interview and those made in two subsequent observations 
of the student's performance in class. Columns 1 and 2 show the corre- 
lations for those instances when the same staff member conducted the 
interview and made the observations. Columns 3 and 4 report the corre- 
lations for those instances when one person conducted the interview and 
another staff member made the observations. Column 5 shows the corre- 
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1 CORRELATION COEFFICIENTS OF CRITERION RATINGS 

MADE FROM INTERVIEWS AND OBSERVATIONS 
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lations between the single rating given by the Departmental Supervisor 
and ratings on each criteria given by the Division of Teaching staff 
person on his second observation. 

While the correlations are all relatively low they are significantly 
greater than zero. It is obvious that the fifth hypothesis was confirmed 
in the main: when the same person conducts the interview and makes the 

observation his two estimates correlate more closely than when one person 
conducts the interview and another makes the observation. The only ex- 
ception involves the criteria related to logic and then the differences 
are so slight as to be insignificant. No explanation for the relatively 
high correlation (.26) on Criterion VIII between the interview and the 
first observation when made by a different person is apparent. The cor- 
relation with the second observation drops back to .05. 

One can not completely reject the first hypothesis, although the 
evidence is not conclusive. Even the highest correlation of .40 has an 
index of forecasting efficiency of only 8.4 percent. While the corre- 
lations are relatively higher on the personality criteria and the subject- 
matter -organization criteria than on those related to logic, they are not 
high enough to warrant placing much confidence in an interview as a pre- 
dictor of teaching behavior. 

There is some evidence for accepting the third hypothesis that in- 
formation on subject matter and organization can be obtained in an inter- 
view. Most of the correlation on Criteria V (Subject Matter) and II 
(Organization) are relatively high. This is especially true for Depart- 
mental Supervisors. 

The second hypothesis that the interview can predict subsequent 
classroom behavior must be rejected. When one eliminates the logic cri- 
terion, the lowest correlation was obtained for Criterion I (Friendliness). 
Apparently this aspect of personality appears differently in an office 
interview and a classroom teaching situation. Criterion III (Surgency) 
and Criterion IX (Professional Potential- -global rating) have the highest 
composite correlations. 

For one semester during the project Departmental Supervisors, who 
interview students as part of the assignment procedure, estimated the 
student's success as a student teacher on a seven-point scale. In effect 
this was a rating on Criterion IX. Column 5 of Table 5.7 shows the cor- 
relations between these ratings and criterion scores given by the staff 
for the second observation. While these correlations are too low to be 
of practical value they are in the main somewhat higher than the corre- 
lations obtained when the staff estimated each specific criterion. Again 
correlations on the logic criterion were negligible as was the correlation 
for Criterion I (Friendliness). Apparently Departmental Supervisors per- 
ceive the following criteria as important: II (Organization), IV (Self- 

Concept), V (Subject Matter) and, to a lesser degree, VI (Communication). 

The correlation between Departmental Supervisor estimate and the 
student's grade-point average was .57 as compared with a .37 for that of 
the staff. This suggests that Departmental Supervisors were more in- 
fluenced by the student's academic record than were Division of Teaching 
staff. 



That interviews are not very reliable predictors of classroom be- 
havior should not be surprising in the light of research conducted largely 
in industry. Hollingsworth's classical study found an almost complete 
lack of agreement when twelve sales managers ranked fifty- seven applicants 
on the basis of an interview .4 

The low correlation found between criterion estimates and other data 
descriptive of the students is consistent with other studies. 

Marsh and Wilder in summarizing some 900 reports of research on ef- 
fective instruction reported that, among others, none of the following 
had value as a predictor of rated instructor competence: intelligence, 

education, scholarship indicated by grade-point average, knowledge of 
subject matter, professional information, and personality tests. 5 



H. L-* Hollingsworth, Judging Human Character (New York: Appleton- 

Century, 1922). 

5 Joseph E. Marsh and Eleanor W. Wilder, Identifying the Effective 
Instructor : A Review of the Quantitative Studies . 1900-1952 (San Antonio, 

Texas: Air Force Personnel and Training Research Center, Lackland Air Force 
Base, 1958), p. 6 . 113 



CHAPTER VI 



CONCLUSIONS AND IMPLICATIONS 
Conclusions 



The nine criteria provided an adequate rubric for evaluating student 
teacher performance. Professionally qualified University supervisors 
were able to make evaluative judgments of student teacher behavior on the 
nine evaluative criteria by observing the student teacher in the classroom 
with sufficient reliability for the rating to be meaningful and useful. 

The reliability of the appraisals was improved by special training. 

Less difficulty in making evaluative judgments was encountered with 
respect to Criteria I, II, III, IV, V, VI and IX than with Criteria VII 
and VIII. 

Student teachers involved in this study rated the lowest on Criteria 
VII and VIII which are concerned with reasoning, logic and the process of 
thinking, and highest on Criteria II, IV, V and VI which are concerned 
with organization and personality. 

Student teachers at Indiana State University devoted only a minor 
fraction of their classroom activity to higher order intellectual processes. 

The correlations between estimates on the nine criteria and other 
data were so low as to be of little predictive value. The highest correla- 
tion, which was with Cumulative Grade-Point Average, had an index of fore- 
casting efficiency of only four percent. No relationships were found with 
scores on the Scholastic Aptitude Test, the Cornell Test of Critical Think- 
ing, or TCAP records of the way the student spent his time in the class- 
room. These findings are consistent with those of past research which has 
been described in these terms: ". . . the majority of educational research- 
ers have been saying for the last decade: we do not know how to define , 
prepare for , or measure teacher competence . "1 

Sufficient relationships with slight predictive value were found 
with some scores on the 16 PF Questionnaire to suggest the value of fur- 
ther study. 

Variations in observational practices such as timing, length or 
frequency do not materially influence reliability. 

Interviews are not satisfactory predictors of student teacher class- 
room behavior. Global estimates of professional potential made by trained 
college supervisors are significantly and positively related to similar 
predictions made by the cooperating supervising teachers in the public 
schools . 

While the nine criteria were assumed to consist of eight discrete 
elements and one composite element, factor analysis revealed only one ma- 
jor factor identifiable as "personality a minor factor identifiable as 
"logic" or "thinking," and a minor factor identifiable as "organization." 



^Bruce J. Biddle, 0 £. cit . p.3 
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Implications 



When this project was inaugurated, the investigators believed 
that one of the chief purposes of education was the improvement of 
the student's ability to think. Three years of investigation have 
reinforced this belief and revealed some of the difficulties in- 
volved in dealing with a concept as complex as thinking. The study 
has documented the small amount of classroom time devoted to think- 
ing, and suggests that teachers need to be not only committed to 
the scientific method but also equipped with those pedagogical skills 
which will enable them to help others increase the areas of life sub- 
ject to rational control. This is not to deny the important role 
played by aesthetics, emotions and the non-rat ional . 

The definition of Thinking agreed upon attempted to be inclusive 
of all higher levels of intellectual activity without becoming doc- 
trinaire. As explained in Chapter II, the study was concerned with 
discovering ways in which the teacher's role in the Thinking Process 
could be identified regardless of the teacher's background; that is, 
whether the teacher may have been influenced by formal logic, the 
five steps in the scientific method, the ideas popularized in prop- 
aganda analysis, the concepts associated with General Semantics, the 
Socratic Method, the modern method of inquiry, the "New Think," the 
research approach, or simple chance encounters with ways of discov- 
ering truth. 

The student teacher's need, identified in this study, for the in- 
tellectual skills was echoed in an observation by A. M. Tibbetts, 

. .many students are failing to learn the art of consecutive, log- 
ical thinking and writing. On most issues of importance that arise 
in university life, students are failing to investigate fully, clarify 
premises, define terms, think logically, use evidence properly and 
write (or speak) precisely, truthfully and to the point. "2 He goes 
on to propose a new college course called "Investigating, Thinking, 
and Arguing." 

In the past, key words in teacher education included life ad- 
justment, human relations, democracy, core, general education and 
individualized instruction. The current educational key words include 
relevance, role differentiation, interaction, media and programmed in- 
struction. This study suggests the need to emphasize the pedagogical 
processes related to thinking. The study has been of practical use in 
alerting student teachers to the potentials of improving the intellec- 
tual level of classroom discourse. It has indicated the need for still 
more effective instructional material and better teaching techniques 
for helping students think. 

While this study has made some progress in developing concepts, 
instruments and techniques for recording and rating student teacher 
classroom behavior, further development and refinement are needed. 



^A. M. Tibbetts, "To Encourage Reason on the Campus: A Proposal 
for a New College Course in Thinking and Writing," American Associa- 
tion of University Professors Bulletin 54.4 (Dec. 1968), pp.466 ff. 
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In accepting the paradigm Pt^ Dt«f Rt-f Pp-f Dp-*- Rp4- p t+ etc *> 
where P = perceiving, D = diagnosing and R = reacting, subscripts t = 
teacher and p = pupil, 3 as an appropriate analysis of teaching, one 
recognizes that interaction is a necessary, but not sufficient, con- 
dition for teaching success. There must be interaction but it alone 
is not enough. The keenness of the perception, the accuracy of the 
diagnosis and the range of the reactions will determine quality. The 
criteria used in this study are useful in evaluating the quality of 
the teacher's classroom behavior. 




0. Smith, 



"Concept of Teaching," ££. cit . 
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APPENDIX A 



GUIDE FOR ASSESSMENT OF SECONDARY STUDENT TEACHER PERFORMANCE 



Procedures for Use of the Secondary Student Teacher Performance 
Profile (SSTPP) in Observing, Rating, Recording, and Reporting 



Supervisor's Observation Procedure 

A. Preparation for Observation 

1. The college supervisor and student teacher should become ac- 
quainted at a seminar immediately preceding student teaching. 

2. An administrative visit is to be made to the student in his 
school during the first two weeks of student teaching. This 
visit provides for: 

a. Orientation of principal and supervising teacher to the 
student teaching program, and 

b. A brief conference with student teacher concerning 
schedule, adjustment, problems, etc. 

The SSTPP form is not used on the first visit. 

3. The college supervisor should be familiar with: 

a. "Personal Information Form"- -A four-page document 
completed by the student when he applies for student 
teaching, and 

b. Record of courses taken and grades earned in teaching 
field, and 

c. The Student Teaching Journal kept by student and super- 
vising teacher. The Journal provides a log of the stu- 
dent's activities after arriving at the school along 
with a cooperative section which includes exchanges 
between the student teacher and his supervising teacher 
concerning philosophical and procedural questions and 
mattc*.rs of detail. It also contains the student 
teacher's fortnightly summary. 

B. Observation Procedure 

1. The supervisor should greet student teacher and supervising 
teacher prior to class. 

2. Observations should be made from an inconspicuous position 
in the classroom. 



C. Rating and Recording Procedures 

1. Ratings should be recorded immediately after the end 
of the observation. 

2. All items for which evidence is observed are to be 
marked by an X on the number deemed appropriate. Where 
both poles of the criterion are approximately equally 
valid the middle number 4 should be marked. 

3. Items for which no evidence is observed are to be marked 
on the N. 

4. Questions on critical incidents affecting interpretation 
of a particular quality are to be written on the back of 
the card. 

5. Additional rating procedures to be followed during or 
immediately following class: 

a. A check (v') may be placed on items numbered II and 
V in addition to an X if any insight or information 
is received from sources other than the classroom 
visit which contradicts the rating made during the 
classroom visit. 

b. The following data are to be recorded on the card: 

(1) week of student teaching in which observation 
was made 

(2) grade level of students in class 

(3) subject being taught 

(4) date of observation 

(5) whether it was the second or third visit 

(6) which experimental treatment was being applied. 

Completed cards are to be turned in to director at the end of 
the week. 

II. General Policies 

College supervisors do not have access to previous ratings of stu- 
dent teachers when making further observations. 

No explanation of the SSTPP should be given to the student teacher 
or the supervising teacher at this time. After the reliability and 
validity have been determined we may decide to discuss the obser- 
vations with the persons involved. 
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SSTPP Form 2 



CODE 



NAME 



CUM 



MAJOR 
CODtl NAME [cum 



MINOR 

godeI name |cum 



ESTIMATE 
CUM | X Y Z 



ASSIGNMENT 



PJ2RC 



SUPER 



RESEARCH DATA 



UNDERSTANDING. FRIENDLY 



VS 



n r 

PLANNED, ORGANIZED. RESPONSIBLE 



I EGOCENTRIC, ALOOf N 



n © r 

UNPLANNED. DISORGANIZED. IRRESPONSI1LE N 



VS 



T 1 5" 

STIMULATING. IMAGINATIVE. SURGENT 



T 



7 m r 

DULL, ROUTINE, UNIMAGINATIVE N 



VS 



: m 

) 

I 

i 11 

» 

i 

! TL 

:ax 

!» 



T 



PERCEIVES SELF AS COMPETENT 



VS 



HAS MASTERY OF FACTS i ORGANIZING PRINCIPLES OF FIELD 



VS 



1 2 " 

COMMUNICATES WELL i EMPATHE T ICALLV 



VS 



S. 1 3 1 

CLASSROOM DISCOURSE CHARACTERIZED BY REASONING OR CREATIVE THINKING 



•* 

VS 



I 



T 



i 



2m- 

iz 



DIRECTS ATTENTION TO PROCESS OF THINKING! 



VS 



1 Z" 

HIGH PROFESSIONAL POTENTIAL 



VS 



6 T~ 7 

PERCEIVES SELF AS I.ESS THAN ADEQUATE N 



7 T - 

HAS ONLY MINIMUM KNOWLEQPg OF FIELD N 



I 6 ; 7 

COMMUNICATES INEFFECTIVELY I PERFUNCTORILY N 



B | 6 "" | 7 

CLASSROOM DISCOURSE CHARACTERIZED BY SIMPLE RECALL N 



5 | © | 7 

FAILS TO CALL ATTENTION TO PROCESS OF THINKING N 



~r 



© " "1 7 

LOW PROFESSIONAL POTENTIAL N 



r 



COMMENTS: 



OBSERVER : 



July 2, 1968 

REVISED INSTRUCTIONS FOR CRITERION VII (EXPERIMENTAL) 

Score as a "1" 

If the major share of teacher's questions are open-ended or thought- 
provoking. 

If teacher frequently translates principles into terms which are in 
the pupils' fields of experience. 

Score as a "4" 

If teacher ignores good opportunities for thought part of the time 
and seizes them part of the time. 

Score as a "7" 

If students are never asked "why?" or "how?" 

If students are not permitted a moment to think of answer. 

If no analogies to students' experiences are given. 

REVISED INSTRUCTIONS FOR CRITERION VIII (EXPERIMENTAL) 

Score as a "1" 

If teacher makes students aware of the problem and the process for 
solving it. 

If students actually comprehend the problem. 

Score as a "4" 

If teacher understands the problem and meaning of terms but fails to 
communicate it to students. 

If teacher assumes students will comprehend the process. 

Score as a "7" 

If teacher never identifies the problem nor defines terms. 
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IBM B305IC 



GLOSSARY OF OPERATIONAL DEFINITIONS FOR 
SECONDARY STUDENT TEACHER PERFORMANCE PROFILE 

OU£e/Uon I-Un.de/utancUng, F/u.cndly va . EgoceytfnUc, Aloof 

Teachers who are described as having a high degree of the quality 
indicated by this criterion are characterized by such terms as friendly, 
understanding, tactful, good-natured, sympathetic, kindly, democratic, 
fair, approachable, gregarious, cooperative, genial, ’’looks on the bright 
side, 11 enjoys the contact with his class* Superficial friendliness and 
mothering behavior should be recognized and given a low rating. 

Criteria I, II, and III are virtually Ryans' XYZ factors. 

Illustrative classroom behaviors: (The specific behaviors are con- 

sidered to be parallel or synonymous. Students need not rate high on 
all examples to be rated high.) 

Unde/U landing , F'Ucndlu V4. Egoce.nI/u.c, Aloof 

1 2 3 4 5 6 7 



1. Shows concern for a pupil's 
personal emotional problems 
and needs . 


1. Recognizes only academic 
accomplishments of pupils; 
no concern for personal 
problems; scolds. 


2. Tolerant of errors on part 
of pupils. 


2. Completely unsympathetic 
with a pupil's failure 
at a task. 


3. Finds good things in pupils 
to which to call attention. 


3. Calls attention only to 
very poor work. 


4. Listens encouragingly to 
pupil's viewpoint. 


4. Impatient. 


5. Behavior that invites 

friendliness from all pupils. 


5. Stiff and formal in re- 
lations with pupils. 


6. Goes out of way to be pleas- 
ant and/or to help pupils. 


6. Hypercritical, fault find- 
ing, apart, removed from 
pupil activity. 


7. Smiles and speaks to indi- 
vidual pupils; knows names. 


7. Reserved and sober; doesn' 
know names of students. 



Basic References: 

David Ryans, Characteristics of Teachers : Their Description^ 

Comparison , and Appraisal (Washington, D.C. : American Council on 

Education, 1960). 

E. J. Amidon and Ned A. Flanders, The Role of the Teacher in the 
Classroom (Minneapolis: Paul S. Amidon & Associates, Inc., 1963). 
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CtvUtoJvLon 11— Planned, Organized \M. Unplanned, Vl^ongawized 

Responsible lAAesponslble 

Teachers associated with a high degree of the quality indicated by 
this criterion are described as businesslike, systematic, responsible, 
consistent, definite, thorough, self-controlled, well-prepared. 

Illustrative '’lassroom behaviors: 

Planned, Organized, Responsible vs. Unplanned, Vis organized, 

Iwivsponslble 

7 2 3 4 5 6 7_ 



1. Has a detailed lesson plan; 
has materials that will be 
used. 

2. Tells class what to expect 
during period; has next 
assignment planned. 

3. Objectives of the lesson are 
clearly discernible; pro- 
ceeds with assurance. 

4. Anticipates and prepares an- 
swers for student questions. 

5. Keeps discussion focused on 
objectives. 



6. Is aware of school regulations 
and is guided by them. 

7. Punctual. 

8. Gives definite directions and 
checks on responses. 

To be Checked Out of 

1. Does he understand and is he 
following directions given 
in seminar? 

2. Meets obligations in record 
keeping. 



1. Has no lesson plan; ma- 
terials are not available 
when he needs them. 

2. Class members see no organi- 
zation in what they are doing 
next assignment unplanned. 

3. Objectives not apparent; 
undecided as to next step. 

4. Is surprised and confused 
by quest i .Zjli ** • 

5. Easily distracted from matter 
at hand; course of action 
easily swayed by circum- 
stances of the moment. 

6. Ignores school regulations. 

7. Does not perform own duties 
on time. 

8. Assignments and directions 
indefinite; no evidence of 
follow-up. 

Class 

1. Vague about assignments and 
is not doing them well. 

2. Careless and evasive in 
record keeping. 



Basic reference: 

David Ryans, Characteristics of Teachers : Their Description , Compari - 
son , and Appraisal (Washington, D.C.: American Council on Education, 1960). 
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Cn itzAlon III — Stimulating, Imaginative V6, Dull, Routine 

SuAgent Unimaginative 



Teachers who possess high degrees of this quality are described as 
original, adaptable, stimulating, resourceful, imaginative, ’’puts pupils 
on their own,” encourages pupil initiative. This is the Z factor de- 
scribed in Ryans. 

Illustrative classroom behaviors; 

Stimulating , Imaginative , SuAgent v-6 . Vult, Routine , Unimaginative 

1 2 3 4 5 6 7 



1. Highly interesting presenta- 
tion; got and held attention. 

2. Clever and witty; enthusi- 
astic, animated. 

3. Assignment challenging. 

4. Took advantage of pupil 
interest. 

5. Seemed to provoke thinking; 
provoked strong esthetic 
appeal . 

6. Uses what seem to be original 
and relatively unique devices 
to aid instruction. 

7. Tries new materials or 
methods . 



8. Resourceful in answering ques- 
tions; has many pertinent and 
novel illustrations available. 



1. Class seems bored, unin- 
terested. 

2. Pedantic, boring, phlegmatic, 
bored-acting. 

3. Fails to provide challenge. 

4. Failed to capitalize on 
pupil interest. 

5. Class lacked enthusiasm; 
lacked interest. 



6. Uses routine procedures 
without variation. 



7. Does not depart from pro- 
cedure to take advantage of 
a relevant question and 
situation. 

8. Not resourceful in answering 
questions or providing ex- 
planation. 



Basic reference; 

David Ryans, Characteristics of Teachers ; Their Description , Compari - 
son , and Appraisal (Washington, D.C. ; American Council on Education, 1960). 
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Cnttenton H/--Pe/icetve& Sei& cu> vt > . PeAcetve 6 Setfi cu Lew Than 

Competent Adequate 

Teachers who possess a high degree of this quality tend to see them- 
selves as liked, wanted, worthy, and able to do a good job of whatever they 
undertake. This is an attempt to rate self-confidence. 

Illustrative classroom behaviors: 

PeAcecve6 Set£ cu> Competent v-6. PeAcetves Set e& Lew Than 

Adequate 

12 3 4 5 6 7 



1 . 


Speaks confidently; self- 
confident in relations with 
pupils. 


1 . 


Faltering, hesitant in 
speech, timid in relation 
with pupils. 


2. 


Takes mistakes and/or criti- 
cism in stride. 


2. 


Disturbed and embarrassed 
by mistakes and/or criticism. 


3. 


Actions are reasonable, ag- 
gressive, and spontaneous. 


3. 


Appears timid and shy. 


4. 


Poised. 


4. 


Lacks poise. 


5. 


Accepts new tasks readily. 


5. 


Offers excuses for not 
acting, delays. 



Basic references: 

Arthur W. Combs (ed.), Perceiving . Behaving . Becoming . Yearbook, 

1962 (Washington, D.C.: Association for Supervision and Curriculum 

Development, 1962). 

Arthur W. Combs, The Professional Educa tion of Teachers (Boston: 
Allyn & Bacon, 1965). 

Robert E. Bills, About People and Teaching . Bulletin of the Bureau 
of School Service, Vo 1. XXVIII, No. 2 (Lexington: University of Kentucky, 

December, 1955). 
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CniXeAion l /--Ha* MaAteny oi Fact* " v*. Hoa Only Minimum Knowledge, oi 
and Organizing Pninei- Field 

pleA o i Field 

A teacher who possesses a high degree of this quality recognizes impor- 
tant and significant knowledge in his f ield--concepts , generalizations, and 
relationships. He recognizes the organizing principles, or the basic ideas, 
of how things are related. This is sometimes referred to as the inquiry 
structure of the discipline. 

Illustrative classroom behaviors: 

Hoa MaAteny oi Facti and Ongani- va. Hoa Only Minimum Knowledge oi 
zing Pni.nei.pleA oi Field Field 

‘ J 2 3 4 5 6 7 



1. Presentation concerned with 
basic principles of the field. 

2. Organized ideas, concepts, 
and principles on a recogni- 
zable priority system. 

3. Drew examples and explana- 
tions from various sources 
and related fields. 

/ 

4. Leads his class to form and 
test hypotheses. 

5. Approach to subject was in 
spirit of discovery. 



1. Presentation simply reviews 
the facts from the text. 

2. Presentation or discussion 
was not directed toward any 
central idea or generally 
accepted generalizations. 

3. Failed to enrich the class 
with illustrations familiar 
to students or from related 
fields . 

4. Inaccurate or irrelevant 
comments; emphasizes mastery 
of unrelated facts. 

5. Approach to subject was one 
of routine examination of a 
given amount of materials. 



Basic references: 

Harry S. Broudy, B. 0. Smith, and J. R. Burnett, Democracy and Excel 
lence in American Secondary Education (Chicago: Rand McNally, 1964). 

Jerome Bruner, The Process of Education (Cambridge, Mass.: Harvard 

University Press, 1962). 

Albert E. Hickey and John M. Newton, The Logical Basis of Teaching: 
I. The Effect of Subconcept Sequence on Learning (Newburyport, Mass.: 
ENTELEK Incorporated, 1964). 
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Basic references (Continued): 

William A. Jenkins (ed.), The Nature of Knowledge (Milwaukee, Wisconsin 
School of Education, University of Wisconsin at Milwaukee, 1961). 

Philip H. Phenix, "The Architectonics of Knowledge," in Stanley M. 

Elam (ed.), Education and the Structure of Knowledge (Chicago: Rand 

McNally, 1965). 
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C tutenion VI —Communicate* Well and v- 4 . Communicate* Ineffectively and 

Empatketically Ve/ifunctoMy 

Teachers who possess a high degree of this quality show acute sensi- 
tivity to the perceptions of pupils and make use of these insights to make 
presentations at their level of understanding. A detailed analysis of the 
communication function is found in Smith and Ennis. 

Illustrative classroom behaviors: 

Communicates Well and Communicate * Ineffectively and 

Empatketicalty v6 . PeAfunctonity 

12 3 4 5 6 7 



1. Reacts to expression of stu- 
dents by asking if there are 
questions or whether a stu- 
dent can give an example. 

2. Draws examples from local 
community or current interests 
of youth of the age group being 
taught. 

3. Expresses pleasure at re- 
ceiving student questions and 
comments . 

4. Makes effective use of audio- 
visual aids to supplement 
communication. 



5. Analyzes and answers student 
questions efficiently. 

6. Has no distracting manner- 
isms. 

7. Speaks fluently. 

8. Diagnoses readiness of 
students . 



1. Presents material without 
recognizing obvious indica- 
tions of confusing or per- 
sonal interest on part of 
individuals . 

2. Uses few examples or ones 
that serve to confuse the 
student. 



3. Shows impatience with stu- 
dent interruptions and 
digressions . 

4. Makes no attempt to adapt 
activities or materials to 
needs and interests of 
students. 

5. Makes little attempt to 
understand question; an- 
swers in rambling fashion. 

6. Has nervous mannerisms 
which distract. 

7. Speaks hesitantly. 

8. Unaware of student interest 
and understanding. 



Basic references: 

George Gerbner, "A Theory of Communication and its Implication for 
Teaching," in Louise M. Berman (ed.), The Nature of Teaching (Milwaukee, 
Wis.: School of Education, University of Wisconsin at Milwaukee, 1962). 

B. 0. Smith and Robert H. Ennis, Language and Concepts in Education , 
Chapter 6 (Chicago: Rand McNally, 1961). 
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C/iite/iion l/II- -C&UMoom Viicouue va, ClaAAtioom Vi&cou/ue 

Characterized by Reason- Characterized by Simple 
ing and Creative Thinking Recall 

A teacher who possesses a high degree of this quality helps students 
to go beyond specific recall of facts into an understanding and applica- 
tion of the problem-solving process. 

Illustrative classroom behaviors: 

Classroom Vi&coune Characterized ClcuMoom Vi&coune Ckaracter- 

by Reasoning and Creative Thinking v&. ized by Simple Recall 

12 3 4 5 6 7 



1. Seeks definition of problems 
with his class. 



2. Leads his class in a search 
for possible solutions to 
problems . 

3. Leads class to decide upon 
the most promising solution 
to problems . 

4. Leads class to evaluate and 
revise solutions previously 
reached by the class. 

5. Encourages students to make 
wider application of general 
principles discovered. 

6. Major share of teacher's 
questions are open-ended. 

7. Permits a time lapse to occur 
after asking a question. 

8. Frequently relates to experi- 
ences of pupils. 



1. Raises own questions and 
answers them; or uses 
questions given and an- 
swered in the text. 

2. Assumes a single correct 
solution to a problem. 



3. Gives the single "best" 
solution. 



4. Requires uncritical ac- 
ceptance of facts. 

5. Teaches facts unrelated 
to application. 

6. Students are never asked, 
"Why?" 

7. Students seldom given even 
a moment to think. 

8. Makes no analogies to 
students' experiences. 



Basic references: 

Mary J. Aschner, "The Analysis of Classroom Discourse--A Method and 
Its Uses" (unpublished doctoral dissertation. University of Illinois, 
Urbana, 1958). 

John C. Wilson, Language and the Pursuit of Truth (Cambridge, 
England: Cambridge Press, 1960). 
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Category i/I II — VinectA Attention to va . Volt 6 to Call Attention to 

the Logical Operation* the Logical Ope/iationA 

in Thinking in Thinking 

A teacher who finds opportunities to point out and analyze the logical 
operations in thinking will score high on this criterion Teachers who help 
pupils become aware of the processes they follow in identifying and solving 
problems will score high. Teachers who are concerned only with subject 
matter will score low. 

Illustrative classroom behaviors: 

ViAectA Attention to the Logical Tails to Call Attention to the 

Opes itiom in Thinking va. Logical Operations in Thinking 

12 3 4 5 6 / 



1. Recognizes and points out 
that confusion arises from 
different definitions of 
terms. "You can't disagree 
unless you are talking about 
the same thing." 

2. Recognizes and points out 
that differences or arguments 
arise from contrasting views 
of what is worthwhile or best. 



3. Points out the diffesrences 
between what is observed and 
what is inferred from the 
observation. 

4. Asks for and demands examina- 
tion of evidence. 

5. Faces up to the problem where 
conflicting evidence or con- 
tradictory facts are presented 
by teaching the laws of evidence 
and rules of proof. 

6. Leads students to state 
assumptions. 

7. Helps students find their way 
through the steps of problem 
solving. 

8. Makes beliefs truer. 



1. Defines terms only accord- 
ing to what the dictionary 
says. Uses authoritarian 
rather than agreed upon 
meanings as basis for defi- 
nition. 

2. Ends an argument with a shrug 

and such comment as: "That's 

one person's opinion. I have 
mine. Let's get back to the 
subject." 

3. Fails to distinguish between 
fact and inference. 



4. Makes frequent dogmatic 
statements . 

5. Ignores cases of loose reason 
ing or contradictory state- 
ments . 



6. Asks a question that requires 
thinking but doesn't wait 
for students to think. 

7 . Either gives answer or 
avoids the problem. 

8. Accepts beliefs and opinions 
uncritically. 
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Basic references: 



Arno A. Bellack, Ronald T. Hyman, Frank L. Smith, Jr., and 
Herbert Kliebard, The Language of the Classroom , Meanings Communi- 
cated in High School Teaching, Part II, USOE Cooperative Research 
Project No. 2023, 1965. 

Kenneth D. Benne, George E. Axtelle, B. Othanel Smith, and 
Bruce Raup, The Improvement of Practical Intelligence (New York: 
Harper, 1950). 

Morris R. Cohen and Ernest Nagel, An Introduction to Logi c and 
the Scientific Method (New York: Harcourt, Brace, 1934). 

James J. Gallagher, Mary Jane Aschner, and William Jenne, Pro - 
ductive Thinking of Gifted Children in Classroom Interaction . CEC 
Research Monograph Series B., No. B-5 (Washington, D.C.: The Council 
for Exceptional Children, NEA, 1967). 

Louis E. Raths, Selma Wassermann, Arthur Jonas, and Arnold M. 
Roths te in, Teaching for Thinking - - Theory and Application (Columbus, 
Ohio: Charles E. Merrill, 1967). 

B. 0. Smith and Milton Meux, A Study of the Logic of Thinking , 
USOE Cooperative Research Project No. 258 (7257) (Urbana, 111.: 
Bureau of Educational Research, University of Illinois, 1965). 

(Trial Edition.) 

H. Taba, S. Levine, and F. F. Elzey, Thinking in Elementary 
School Children , USOE Cooperative Research Project No. 1574 (San 
Francisco State College, 1964). 

John C. Wilson, Language and the Pursuit of Truth (Cambridge, 
England: Cambridge Press, 1960). 

Asahel D. Woodruff, Basic Concepts of Teaching (San Francisco: 
Chandler, 1961). 
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CtUt&iion IK — High PsiofieAAion&t v*. Low Ptio£eA6iomZ 

PotzwtiaJi Poie.vitial 

The rating on this criterion is not an average of the other quali- 
ties in this profile. It goes bevoqd these qualities to include all 
factors and feeling concerning the professional potential of the student 
teacher. This includes such considerations as success in a typical school 
situation, desire to achieve the maximum potential for himself and his 
students, and interest in the improvement of the profession. It consti- 
tutes a global estimate. 



Basic references: 

Louise M. Berman (ed.), The Nature of Teaching (Milwaukee, Wis.: 
School of Education, University of Wisconsin at Milwaukee, 1962). 

J. Bruce Biddle and William J. Ellena (eds.). Contemporary Re- 
search on Teac her Effectiveness (New York: Holt, Rinehart & Winston, 

1964)7 

Arthur W. Combs, The Professional Education of Teachers (Boston: 
Allyn & Bacon, 1965). 



APPENDIX B 



INSTRUCTIONS FOR USING THE TEACHER CLASSROOM ACTIVITY PROFILE (TCAP) 
AND DEFINITIONS AND ILLUSTRATIONS OF TERMS 



The Teacher Classroom Activity Profile (TCAP) is printed in two forms 
The 8” x 11" no-carbon-required triplicate form B and the IBM card form C. 
The NCR form B will generally be used to record observations in the class- 
room- -one copy (yellow) is for the student teacher, one copy (white) is 
for the Division of Teaching, and one copy (pink) is for the Departmental 
Supervisor. The IBM card will be used for key punching, filing, and re- 
search purposes. 

The completed profile provides data which enable the student and 
supervisor to "reconstruct the experience" and examine the effectiveness 
of the teaching acts and consider alternatives. The completed profile 
constitutes a sequential account of the major activities in which the 
teacher engages during the class session. 



Instructions for Use of TCAP 

The observer records a continuous line moving among the seven major 
activities in three-minute intervals. Explanatory notes should be keyed 
to the column number which indicates the sequence of three-minute inter- 
vals. If there is just a momentary shift in categories, a vertical line 
going up or down to the proper category should be made without interrup- 
tion of the general flow of the regular profile graphs. 



It has been found helpful to indicate the time of day at each of the 
three-minute intervals, starting in column 1 with the minute the class 
starts and then recording the time at three-minute intervals after that 
in the numbered squares. If a teacher interrupts a presentation to repri- 
mand a student or to ask for attention, since this activity is classified 
as Management- -Non-Learning, a line would go up to section MN or, simi- 
larly, if the teacher is conducting a recitation and stops a moment to 
ask a question which really provokes thinking and then goes on with the 
recitation, a line would drop down to Logical Thinking. If this acti- 
vity goes on for a minute or more, the graph should show that as a part 
of the continuous line. It is possible to indicate one- or two-minute 
sequences by using one- third or two- thirds of the space. For summary 
purposes, count four such lines as the equivalent of one minute. TCAP 
forms should be completed including the summary computation and returned 
to Research Office of the Division of Teaching at the end of each platoon. 
Be sure to include identification data--student and observer. 

The total number of minutes should, of course, add up to the total 
number of minutes spent in observation. The percentage should be com- 
puted approximately- -that is, to the nearest percent. Percentages should 



tally to 100 percent. A table to facilitate this computation is avail- 
able in Dr. Beasley's office. The NCR paper makes it possible for the 
observer to provide students with a copy of the analysis. The left-hand 
column, "explanatory notes," should be used to describe any unusual move- 
ment of the profile or to identify something that happened that might be 
discussed. The right-hand section, called "anecdotal records," could be 
used to make evaluative judgments, jot down ideas, or make suggestions 
that may be helpful to the student. Some of the staff have found it help 
ful to mark an X in the appropriate category at the time an opportunity 
to help students improve their thinking was missed. 

See attached example of completed form. 



Definitions of Major Categories of TCAP 

While the terms used to identify the seven categories of teacher 
activity carry common connotations, their use in this study is restricted 
to the precise meanings as defined and illustrated below. The definitions 
and examples serve as a basic point of reference. The precise distinctions 
among the various categories are clarified in staff discussions and in- 
dividual conferences. TCAP can be used in both academic classes and 
laboratory or shop-type classes; however, the precise meaning of some 
categories varies with the type of class. 

Glossary of terms as applied to academic-type classes: 

(English, Social Studies, Mathematics, Science other than 

Science Laboratories, etc.) 

MN Management- -Non-Learning 

Management of classroom when the teacher is not attempting 
to teach, e.g., reading announcements, taking roll, dis- 
tributing materials, organizing equipment, idle time, 
disciplining pupils, waiting for the bell to ring. 

ML Management- -Learning 

Management of classroom so that learning may occur but the 
teacher is not involved except in a managerial role, e.g., 
showing a sound film, administering a written examination, 
supervising study time, student reports. 

P Presentation 

The presentation of subject matter by the teacher in some 
organized fashion, e.g., lectures, demonstrations, illus- 
trated talks, blackboard presentation, reading. 
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R 



Recitation/Drill 



The solicitation of student responses which call for terse 
memorized data, oral testing to determine if assignments 
have been read, review questions, etc. Include drill and 
practice time here. 

D Discussion/Random 

Random discussion involving student- teacher interaction 
but without analysis or synthesis. "Stream-of-conscious- 
ness" discussion without any apparent focus or purpose 
except to consume time until the period is over, e.g., 

’’talk- talk- talk.” When, discussion does come to a point 
it fits into the next category, LT, Logical Thinking. 

LT Logical Thinking 

Discussion which involves analysis and synthesis. The 
teacher is deliberately encouraging or permitting thinking 
to occur. This category is more than reciting or repeating 
something which has been learned or memorized. When the 
teacher acts to encourage thinking, it should be recorded 
here whether or not the act is successful. Use vertical 
lines to this category when a brief interval of thinking 
occurs in presentations, recitations, or discussion. 

TP Thinking Process 

Deliberate, conscious attention on the part of the teacher 
to the intellectual process, e.g., pointing out to students 
the factual and/or logical basis of their thinking, point- 
ing out errors in reasoning, examining the reliability and 
validity of evidence, examining the adequacy of the sample, 
defining terms, checking assumptions, examining the scien- 
tific method, examining values, seeking reason for con- 
flicting opinions, locating the source of difficulty, 
examining the "method of inquiry." Use explanatory notes 
to report good examples. Put an X on the profile if an 
opportunity to contribute to the thinking process is missed. 

Glossary of terms as applied to laboratory- type classes: 

(Science Laboratory, Shop, Band, Orchestra, Physical Education, 

Typing, etc.) 

MN Management- -Non-Learning 

Basically the same as for academic. Include clean-up and 
wasted time. Record here time in which teacher ignores 
pupils to work on outside activities. 
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ML Management- -Learning 

Basically the same as for academic. Warm-up time, showering, 
dressing, when supervised by teacher. 

P Presentation 

Same as for academic. 

R Recitation/Drill 

Same as for academic. 

D Discussion/Random 

Same as for academic. 

LT Logical Thinking 

Consider all purposeful work which the teacher is supervising 
or directing in this category. 

TP Thinking Process 

Same as for academic. Applies if teacher is working with a 
single teacher, a group, or the total class. 
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The model which evolved from the staff study identified four 
levels of intellectual activity which could be categorized from ob 
servations of teacher behavior. 

Levels of Intellectual Teacher Activity 

Activity 

Level One: Directing, Commanding, Managing, 

Managing Rebuking, Accepting Students. 

These are usually imperative 
statements . 



E Level Two: 

Informing 

n 



Presenting Information, Reporting, 
Describing, Recalling from Memory. 
Getting students to do these. 

These are usually empirical 
statements . 






Level Three: 
Thinking 



Summarizing, Classifying, Explaining, 
Reasoning and Evaluating. Getting 
students to do these. 

These are usually relational state- 
ments . 



Level Four: Thinking about Thinking; Analyzing 

Thinking Process the Processes of Thinking Going on 

in Others; Recognizing the Roles 
Played by Assumptions, Biases, and 
Values; Locating Sources of Misun- 
derstanding. Getting students to 
do these. 




These are usually logical statements. 





This analysis of thinking proved helpful in identifying the various 
categories for classifying student teacher behavior on the Teacher Class- 
room Activity Profile. It also provided the basis of making evaluative 
ratings on Criteria VII and VIII of the Secondary Student Teacher Per- 
formance Profile. 

The schema which follows suggests relationships between this system 
for looking at the teacher's intellectual activities and the staff s in- 
terpretation of the way some other scholars have organized their thinking 
The relationships are approximations and tangential. The purpose of show 
ing them here is to give added meaning to this system of classification 
rather than to compare one with another. 
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RELATIONSHIPS BETWEEN THE SCHEMA DESIGNED FOR THIS STUDY AND THOSE DEVELOPED 
BY OTHERS FOR ORGANIZING IDEAS ABOUT THINKING AND THE TEACHING ROLE 
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APPENDIX C 



ANECDOTAL REPORTS 
ILLUSTRATING CRITERION BEHAVIOR 

The following precis, prepared by the staff of the Division of 
Teaching, were drawn from actual classroom observations to illustrate 
typical criterion estimates of teacher performance. 

Only the relevant aspects of the encounters are reported. No 
attempt has been made to describe the complete context in which the 
event occurred. While none of these incidents by itself would de- 
termine the rating, it does provide an important clue to be weighed 
against other behaviors in determining the final rating. 

These anecdotal reports when used in connection with the Glossary 
and behavioral definitions included in the "Guide for Assessment of 
Secondary Student Teacher Performance" should help observers make more 
reliable criterion ratings. 

Three levels of anecdotal reports are provided for each criterion: 
those which illustrate a high rating of 1, those which illustrate a 
middle evaluation of 4, and those which illustrate a low rating of 7. 



Criterion I- - Understanding , Friendly vs . Egocentric , Aloof 
Rating of 1--High 

In a seventh- grade, noisy, boisterous, low-track English 
class, Mary Jones was trying to gain control. On several 
occasions, the students asked questions at inopportune 
moments. When this occurred, Mary was quick to interrupt 
her presentation to answer the question. She was solici- 
tous in her answers and seemed to be giving the student 
some inside information about how best to learn the 
material. As she introduced a new topic, she cautioned 
the students about pitfalls which they might encounter 
in learning the new topic. She assured the students 
that she was there for the purpose of making it easier 
for them to learn. After explaining a point, she asked 
five or six students, calling them by name, if they were 
sure that they understood. When a student answered 
correctly, she seemed to be delighted at the student's 
accomplishment. In conference after the class, the student 
teacher spoke favorably about various individuals in the 
class . 
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In a junior high English class, the student teacher announced 
that one of the students was moving from the community be- 
cause his father had been transferred. She concluded with: 
"Bill, I am sure the class joins with me in wishing you the 
best of luck in your new school and don’t forget to write to 
us about your new school.” 



Mr. Randolph was expressing his pleasure at the accomplish- 
ments of the students after they had exhibited to their 
parents their projects in science. ”l was so proud of every 
one of you I just couldn't sleep! Timmy, wasn't it great 
your father could be home on leave? Wasn t he pleased with 
the thermometer you made?” 



Rating of 4- -Midpoint 

In a typing class, the student teacher's directions were 
given to the entire class. She glanced impersonally at the 
students' work as she walked about the classroom. When a 
student raised his hand, she sometimes inquired, "Yes?” without 
using his name. She was patient in repeating directions. 
Occasionally she would smile at a student, but, for the most 
part, her facial expression was impassive. While her actions 
could not be rated as friendly, neither could they be con- 
sidered unfriendly. At the end of the period one student 
remained to ask a question. 



The students in a beginning instrumental music group were 
having trouble keeping together in playing the school song. 
"You do these parts OK when you play alone," Miss Gerda 
praised, but, "Now there is no earthly reason you can't stay 
with it when we put them together!” 



The student teacher was observed in a junior high English class. 
During the first part of the period he smilingly spoke to the 
class, kidded some of the boys about their basketball game the 
previous night, asked a girl how long her arm would have to 
remain in a cast, and, in general, gave the impression that he 
was a good-natured, friendly person. His behavior was not 
consistent throughout the period, however. After collecting 
the weekly themes he noticed that one girl had not turned in 
hers and demanded why she had not prepared it. She informed 
him that she had written it at home the previous evening but 
that the school bus had come ten minutes early and that in her 
hurry to board the bus she had forgotten her theme. The studei* 
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teacher said that this was no excuse and gave the entire 
class a short lecture on how they should grow up and 
learn to meet their responsibilities. 



Rating of 7- -Low 

The student teacher was observed in a third-year high school 
German language class. She addressed them by their last 
names, using the German equivalent of Mr. and Miss. She 
was very reserved and sober before the class and created a 
’’mightier than thou" image. At no time did she exhibit 
behavior that invited friendliness from her pupils. She 
missed several good opportunities to praise pupils for good 
work but called attention to poor work on the part of 
several students. She was impatient if a pupil did not 
respond rapidly and appeared unsympathetic when a pupil 
failed to give the correct response. 



In a general science class, the student teacher gave a "quiz" 
during the first part of the period, had students to exchange 
papers, and read the answers aloud. Some of the slower students 
were subjected to ridicule as other students read aloud their 
greatly incorrect answers. Student teacher did nothing to 
correct this situation and indicated to me later "it is a 
fast way of grading papers." 



It was a laboratory in biology. The project was to dissect 
the frogs. Annette was unable to proceed with the project. 
As Mr. Stone questioned her about her inactivity she said, 

"I honestly don’t feel well." Mr. Stone's reply was, "Look, 
you'll never learn how to do this by being silly about it." 



Criterion II- - Planned . Organized . Responsible vs. Unplanned . Disorganized 
Rating of 1--High 

The unit Mr. Evans was teaching in chemistry involved the 
Periodic Table. He began his lesson saying, "During these 
past six weeks we have at times mentioned various compounds 
and elements without going into much detail on them. The 
periodic chart on the wall and the print-out I have given 
you will be very valuable in predicting the properties and 
reactivity of all the known elements. We will see the films 



Chemical Fa milies and Metals vs. Non-Metals, . We also have 
models of atoms and their structure. From these you will 
see how and why elements react to form the many compounds 
that exist today." 



In a general math class the student teacher s objective for ^ 
the week was to teach students how to figure their families 
gas, electric, and water expenses. The student teacher had 
meters which he had borrowed from the companies and was 
able to show students first-hand how to read the meter as 
well as how to compute the bill. 



The student teacher quickly completed the attendance check 
and then turned to the distribution of papers to the students. 
The papers were arranged so that she could hand a group of 
papers to the students in the front seats and they could 
in turn pass back the correct paper to each student. 

"Today we will begin by reviewing the quiz you took 
yesterday. We will take a look at each problem and discuss 
any points that need to be cleared up. After that we will 
take a look at the next set of problems and learn how to do 
those. After that, you will have about fifteen minutes to 
work on the homework so you can ask me about anything you 
do not understand. Friday we will finish this chapter and 
the test will be next Monday." 



Rating of 4- -Midpoint 

The student teacher in health announced that the test would 
be postponed until the next day so that all the classes 
could take it on the same day. He then showed a film on 
the heart. After the film was over, he discussed it briefly. 
Following this, he reviewed the breathing process with a 
series of questions which traced air movement through the 
body. He then returned to a further discussion of the heart. 
He kept discussion focused on the objectives (in this case 
an impending test) and he asked questions in a logical 
sequence. He had not previewed the film in advance and he 
jumped from one topic to the next; then back to the original 

topic. 
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The student teacher in Latin II class was preparing his 
lesson for the next period when I found him. When I asked 
him if I were interfering with his preparation, he answered 
in the negative. After a few minutes of chatting, I asked 
him for his journal. He exclaimed, ”0h YesJ” and found 
it after a few moments of searching. When I asked him 
about his plans for the ensuing period, he stated that he 
would start with a certain list of exercises and that he 
hoped to finish the list during the period. The supervising 
teacher stated that the student teacher’s lesson plans had 
been satisfactory. At the close of the period, the student 
had no suggestion about where to hold a conference. 



After observing a sociology class that the student teacher 
had been teaching for four days I mentioned that I had 
noticed he was having difficulty pacing the class and had 
not gotten to the point in the material where his plans 
indicated he would be. He stated that he was having trouble 
developing adequate plans because, ’’This class likes to 
talk and I haven’t yet found a way to shut them up when I 
want to move on.” 

Rating of 7- -Low 

In a health class that met only two days a week, a student 
asked the student teacher when he would be able to present 
the report he had been assigned four days prior. The student 
teacher replied that the class couldn’t take time to listen 
to the report if they were to finish the text and suggested 
to the student to put it away somewhere and maybe they could 
listen to it someday. 



The student teacher entered the classroom as the bell rang. 
Attendance check and distribution of test papers for 
approximately 20 students required six minutes. No comment 
was made about test results and no grades were announced. 

He then gave an extremely brief (less than five-minute) 
lecture on his topic. He appeared very uncertain of his 
notes and made no gesture to encourage the students to ask 
questions. Although this was to be an introduction to a unit, 
he made no such mention to the class and no follow-up was 
suggested. 
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The student teacher came late to his seventh grade social 
studies class. Before he called the class to order, he 
came back to chat with me. I asked him for the journal, 
but he replied that he had left it at home. After class, he 
told me that he had not started keeping the new cooperative 
section because neither he nor the supervising teacher knew 
how to use it. He was three days behind in his log. He 
seemed surprised that I should expect him to have lesson 
plans. After a prolonged session of taking roll, he opened 
his textbook and asked the class where they had been at 
the close of yesterday's lesson. The students argued about 
location, and the student resolved the matter by assigning 
a twenty- five minute study period during which the students 
were to read an assigned number of pages. After the study 
period, the student teacher checked upon their reading by 
improvising questions from the textbook. 



Criterion Ill - Stimulating . Imaginative . Surgent vs. Dull, Routine , 

Unimaginat ive 

Rating of 1-High 

In a United States history class the student teacher had 
two boys who were especially gifted in drawing and not 
quite so gifted or motivated in history to prepare each 
day a comic-strip-type serial depicting the events which 
prompted the Civil War. The class contributed suggestions 
toward the end of the period. 



The student teacher was observed in a speech class. As 
part of the introduction to a unit on story telling, the 
teacher told a story herself. The pupils were so inter- 
ested in her enthusiastic presentation that they appeared 
to "hang" on her every word and gesture. At the conclusion 
they spontaneously broke into applause. 



The student teacher in Latin was focusing on the development 
of vocabulary and the ability to converse in the language. 

He had a quick smile and good voice projection. He told a 
story in Latin and used overhead transparencies which he had 
prepared to illustrate key words. Whenever comprehension 
was obviously not achieved, he occasionally drew an illus- 
tration on the chalkboard or attempted to use humor to 
communicate. The students seemed to be enjoying this pro- 
cedure and worked diligently at interpreting the story in 
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English. When he made a mistake in pronunciation, he 
smiled and said that teachers had a right to make mis 
takes, but students did not. All laughed. 



Rating of 4-Midpoint 

The industrial education student teacher spent a few 
minutes describing a part of a machine which would be 
disassembled in the lab. The description was presented 
in the form of a lecture with no use being made of the 
chalkboard or visual materials. He explained that the 
students would need to know this in order to work on 
their small engines. After the ten-minute presentation, 
he dismissed the students to the lab where they worked on 
their projects. He managed to give attention to all and 
kept the students busy on the project. 



Student teacher in first year algebra opened the class 
asking if anyone wanted to see an example put on the 
board. He then worked several examples, putting them 
on the board in deliberate fashion. His presentation 
showed no appreciable verve, although he did smile and 
joke with the students occasionally. 



In a bookkeeping class the student teacher consistently 
used examples which related to farming or rural type 
businesses which he was familiar with and was unaware of 
his failure to be stimulating until one of his "large city 
school" students asked him, "What is a combine?" 



Rating of 7 -Low 

In a seventh grade English class a student remarked that he 
didn't see why they had to memorize the names and spelling 
of the Greek gods and goddesses. The student teacher replied 
that he never cared for this type of Literature either, but 
it was in the book and it was going to be on the test next 
Friday. 



The student teacher in general business spent most of the 
time reading directly from the textbook. He read without 
expression and without any interruption to explain or to see 
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if students had any response. The students sat quietly, 
but obviously were paying no attention. Some worked on 
other homework. Others looked through billfolds and other 
books. Many looked at the floor in obvious boredom. 



The student teacher in American history class took a very 
long time to take roll visually, during which time the 
class became gradually quiet. As he was putting the 
attendance slip on the door, a messenger came with a note 
to be handed to a student. The student teacher accepted 
the note, mused over the name and only after several seconds 
did he call the name of the student. The student teacher 
waited silently until the student took the note, read it, 
went back to his seat for his books, and left the room. 

Eight minutes after the bell, he spoke for the first time to 

the class. 

"Today we're starting a new unit on the westward movement. 

Does anyone have a question?" There was a long pause during 
which he gazed phlegmatically at the class and then down at 
his book. "Who was president at this time?" A student 
hurriedly leafed through his book and raised his hand. The 
student teacher sleepily looked at the hand a few seconds and 
called the student's name. 

"Thomas Jefferson?" 

"That's right, Thomas Jefferson. What were the dates of 
Jefferson's term in office?" There was another search 
through the pages by this same student while the student 
teacher patiently waited. 

"1800 and 1804?" 

"That's right, 1800 and 1804. But did he leave office in 1804?" 
"No." 

"That's right. He left office in 1808 after being elected in 1804." 

The student teacher plodded through thirty minutes of this kind 
of discourse and then announced a study period. He sat at the 
desk during the study period. At the bell, he waited ten 
seconds before dismissing the class. 
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££i. ter i° n IV — Perceives Self as Competent vs . Perceives Self as Less 

than Adequate 

Rating of 1--High 

A student teacher in mathematics was assigned to teach a 
class in modern math for which the student teacher had 
little preparation. The student teacher informed the 
supervising teacher that after looking through the text 
he was sure he could do a good job with it and would 
present his lesson plans to the supervising teacher 
several days in advance so they could check them over 
care fully. 



Student teacher was observed in a second-year French 
class. Before the class she told me that she was 
thoroughly enjoying student teaching and that she 
could hardly wait to begin each of her three daily classes. 
During the class, her pupils caught her in two errors. 

She, on both occasion, smiled, admitted her mistakes, 
thanked the student making the correction, and continued 
undisturbed with her presentation. 



The student teacher in English III class was discussing 
a test with three or four students from the previous 
period when I entered the room. The students were com- 
plaining about the test, but the student teacher was smiling 
and unruffled. When he saw me, he instructed the students 
to see him at the sixth period and dismissed them. He shook 
my hand and asked where I would like to sit. He instructed 
a student to get a chai- for me. As the student teacher began 
to speak to the class, the assistant principal came to the 
door and asked about a student. The student teacher in a 
clearly audible, informative voice said, n 0h, I gave him per- 
mission to do that. I didn't know that it was against the rules 
The student was not at fault. I'm sorry. It won't happen again 
He smiled at the assistant principal, as he spoke. He looked 
directly at the students and waited for them to become quiet 
before he spoke. He interrupted students several times to 
insist that they speak, more loudly. Several times he used 
I think. . ."to summarize a point. After class, he 
explained that he had not written much in the journal because 
he did not have any problem. 




Rating of 4--Midpoint 

The student teacher in biology class taught a well 
organized, effective lesson. When I asked her how well 
she was progressing, she said, "All right, I guess." 

In the journal she expressed some anxiety about not 
being able to "reach" the students. She stated that she 
needed more experience and more background in subject 
matter. She said that she had had a difficult time in 
making out a test. In summary, she said, Oh, I really 
think that I'm doing OK, but I sure have a lot to learn." 



The student teacher appeared rather timid and had little 
to say. He listened in group conservations and asked few 
questions of anyone. In his class presentations, however, 
he appeared to know what he was talking about and projected 
his ideas in a confident manner. He was able to work 
individually with students in the class (drafting class) 
without showing any real timidity. He did not solicit 
criticisms from his supervisor, although he carefully 
listened to whatever he had to suggest by way of improvement. 



The student teacher possessed good personal musicianship 
in illustrating techniques with the viola and piano but 
lacked security in directing the group. Her voice was 
submissive in direction. In counting the time it was 
difficult for students to hear. Finally, she went to the 
piano to play the accompaniment. The students could hear 
her play. She was at ease at this instrument and her 
directing was more successful. 



Rating of 7- -Low 

The student teacher expressed concern that he did not know 
his content in algebra. When I reminded him that his index 
was better than a "B", he said he did not achieve that in 
courses he would be teaching. He stated that he feared that 
he would make mistakes in class and would embarrass himself 
in the presence of the students. He wanted to delay the 
beginning of his teaching and indicated that he had no idea 
of how to plan. He said that he could not see how simple 
arithmetic could be taught to the group that he would have to 
teach. 
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The student teacher was invited by the Future Teachers 
organization of the host school to meet with them and to 
talk with them about her university and the program leading 
to a degree in Education. The student teacher replied that 
she was much too busy since having several papers to grade 
and, besides, she wasn’t very good at those sorts of things 
but if someone would contact the university maybe they would 
send someone out to do it. ”l know, when my college super- 
visor comes around I’ll mention it to him.” 



Student teacher was observed in a tenth-grade English class. 
During the period the class was somewhat noisy in that 
dis tractive ’’talking” was taking place between class members 
in different sections of the classroom. The student teacher 
made no effort to quiet these pupils. During our conference 
following this class, the student teacher said, ’’This is my 
worst class. They give all the teachers in the school 
trouble. I don't know what I am going to do with them. If 
I thought that I would ever get another class like this one, 

I don’t think that I would enter teaching as a career.” 

Criterion V- - Has Mastery of Facts and Organizing Principles o f the Field 
vs. Has Only Minimum Knowledge of Field 

Rating of 1-High 

The student teacher in chemistry introduced the reaction of 
acids and bases. He called the attention of the students to 
various reactions which involve this phenomenon: baking soda 

and vinegar, battery acid and soda, erosion of teeth, acid 
soils, etc. He informed the students about the application 
of this principle which different local industries found useful. 
He also pointed out how the principle would affect their work 
in the study of chemistry. He answered the questions of the 
students with great poise and self-confidence. In conference 
after the class, the student teacher showed that he had a 
clear knowledge of the aims of his lesson. He knew how the 
principle would occur in future chemistry courses and had 
introduced it so that future application would be easy. 



Student teacher was observed in a beginnirg biology class. In 
response to a pupil who asked why a certain relationship was 
true, the student teacher said, ’’The answer to this question is 
beyond the scope of this course and the information needed to 
answer it is gained in a second-year college chemistry course.” 





He continued, "However, since this is a college preparatory 
class, I feel that you will be able to partially understand 
the chemistry of the relationship if I diagram it on the 
chalkboard." He then briefly proved, using chemical symbols, 
the questioned relationship. 



The objective of an eighth-grade English class was to discuss 
similes. Miss Banta read Part I from Evangeline . Her reading 
was excellent. 

She paused to ask, "How can we decide Benedict was an old man?" 

Helen repeated, "'He was hearty as an oak that is covered with 
snowflakes . ' " 

"'White as snow was his hair,'" said Rupert. 

Rachel added, "'His cheeks were brown as oak leaves."' 

"Who can write on the board the names of these comparisons ? 
Ruth?" 

Ruth was pleased as she wrote similes. 

"Do you agree, class?" asked Miss Banta. "Why are they similes?" 



Rating of 4-Midpoint 

A discussion of climate in a geography class was presented by 
Miss Tuttle. This particular school offered experience rich 
in laboratory potential with much equipment available. In 
this situation she was ill at ease. Trouble brewed when she 
was absorbed with the experiments of one student while the 
others took advantage. In conference she explained, I am 
spending so many hours outside class in just learning about 
all this equipment. It is wonderful and I want to teach it this 
way. But, oh, my, I have to learn so much more." 



The student teacher in algebra I introduced the working of 
simultaneous equations by the substitution method. When a 
student asked about the relative advantages of the addition- 
subtraction method as compared with the substitution method, 



the student teacher showed that he had not considered the 
question before. After some hesitancy, he answered the 
student satisfactorily. After class in conference, he 
indicated that he simply followed the book on such matters 
and felt no special obligation to demonstrate applicability 
of the principles involved. 



Student teacher was observed in a business arithmetic class 
where the problems were concerned with insurance rates and 
premiums. He was extremely adept at explaining the correct 
solutions to the assigned problems but was vague when asked 
to explain certain types of insurance such as coinsurance, 
home owners insurance, endowment insurance, and disability 
insurance. 



Rating of 7 -Low 

Student teacher was observed in a tenth-grade health class. 

The topic under discussion was communicable diseases--specif ically, 
influenza, and other similar virus diseases. The student teacher 
followed the textbook topic by topic in leading the discussion. 

Even though approximately twenty percent of the pupils in his 
class were absent with a new virus disease--the "Hong Kong Flu"-- 
the student teacher gave no indication of his awareness that 
such a disease existed. 



Student teacher in social studies (economics) class presented 
a film-strip. After some delay because of a mistake in the 
previous rewinding of the film-strip, he began to show the 
panels with a simple statement that this was a film-strip. 

It was a commercial film-strip designed to show the operation 
and products of an industry. As he flipped to each new panel, 
the student teacher looked at the panel and then announced what 
was obvious to the students, "This is a pineapple field." The 
student teacher read laboriously the printed material while the 
students looked at the same material and read to themselves. 

At the end of the showing, a student asked how much of the film- 
strip would be included on the next test. The student teacher 
was vague and uncertain on this point. The period ended with 
the students wrangling about being held responsible for knowing 
such information. After class, the student teacher said that 
the only reason for showing the film-strip was that it was 
available. 
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In a health class students were expected to recite with 
text books open. The student teacher then outlined on the 
chalkboard the symptoms of various disorders as they were 
given in the text and students copied this into a note- 
book which was later to be turned in for a grade. 



Criterion VT-Co mmunicates Well and Empathetically vs . Communic a t es 

Ineffectively and Perfunctorily 

Rating of 1--High 

The mathematics student teacher reviewed the test results 
with the geometry class. As students raised questions, she 
sought to illustrate as vividly as possible. She explained 
the concept of perpendicular lines by using the desk to 
represent the surface and a yardstick to illustrate the con- 
cept. She constantly asked questions to get students to 
understand the mathematical process involved in each problem. 
She displayed a great amount of patience with students who 
had difficulty comprehending and not once did she appear 
irritated at the students for asking questions. She spoke 
loudly and clearly and she used examples which should have 
been familiar to the students. 



In a class of auto mechanics the student teacher was 
teaching how to measure the cubic inches of displacement 
of the pistons. He used a cut away section of a model of 
a motor in his presentation and concluded by discussing 
with the students the difference between automobile models 
of their family autos such as "Dodge 383," "Chevrolet 307, etc 



Student teacher was observed in a beginning algebra class. 

As part of this lesson the pupils were first introduced to 
the division of polynomials. The student teacher gave the 
rules for and demonstrated the method of working such problems 
using literal numbers. She then asked the class if there were 
questions. A few hands were raised. She said, I can see by 
your hands and the looks on some of your faces that you do not 
completely understand this new process. It is difficult and 
most pupils do have trouble with these problems at first. 
Perhaps, the process will become more clear to you if I work 
an example for you using arithmetical numbers in place of 
literal numbers." Following her second example, all the pupils 
were able to successfully begin working this type of problem. 



Rating of 4- -Midpoint 

The student teacher was attempting to cause the students to 
think about literature and communications media by discussing 
current movies. He asked them to nominate their favorites 
for best movie, best actor, and best actress. He encouraged 
them to respond and attempted to create an informal environ- 
ment by sitting on the desk. He did not (or could not) help 
them detect obvious personal interests (no real hard analysis 
of The Graduate as best movie, for example) and the main 
concepts of communication quality. There was no attempt to 
describe or demonstrate concepts of quality in motion-picture 
production. In other words, he did not get them to think 
beyond the emotional level. Some of his mannerisms, such as 
sitting on the desk for the entire period, may have proved 
distracting. 



Mr. Stout began the lesson by making a study assignment for 
the new chapter in bookkeeping. He rapidly placed an example 
on the board and instructed the class to do the next three 
problems at their desks. Some of the students were working- 
others were puzzled. 

Helen raised her hand saying, "I don't know where you want 
us to start." 



The student teacher presented in lecture form the operation 
of the principle of diminishing returns. The student teacher's 
attitude was formal, and the students were taking notes. 

After twenty minutes of presentation, the student teacher 
asked, "Now, does everyone understand?" There was uneasy 
hesitance among the students, and one girl raised her hand. 

"Question, Susan?" 

"Well, I still don't understand how something can be worth 
more one time than another. How do you know which one to sell 
at a high price and which one to sell low?" 

"Let's go through this again." The student teacher then repeated 
much of his original lecture. At the end of the second run, he 
asked Susan if she understood any better. Susan looked around 
the class. 

"Well, I guess so." 

"Does anyone else have a question?" No one asked any questions. 
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Rating of 7 --Low 

The student teacher in an eighth-grade English class was 
handing back a grammar test. Before he had completed 
handing back the test, several hands were up obviously in 
protest to the marking. Several students voiced their 
dissent. 

"Last week you said it was all right to put a comma there. 

"I have the same as Ellen, but you marked mine wrong." 

"It’s not fair." 

"I don’t see how you can expect us to learn this stuff 
when you don’t tell us the same way twice." 

The student teacher shouted for the students to become quiet 
and to ask their questions one at a time. As he tried to 
explain, however, other students would burst out with further 
objections. Finally, in exasperation, he gave the students a 
study period and threatened them with another test. 



A student teacher in English kept asking students for parts 
of speech of sentences on the chalkboard. It was obvious 
that several students were confused and did not understand. 
The student teacher consistently replied to each wrong 
answer with, "No, now you know better than that," or "No, 
I’m ashamed of you for not knowing that." 



The students in this typewriting class had just returned from 
a pep session. Miss Simpson had stayed in the room grading 
yesterday's papers. The papers were returned with no comments. 
Miss Simpson started the work with, "Now git (get) ready for 
the tin (ten) minute writings. We’ll begin with the sintence 
(sentence) on line 12," 

The room was noisy with students adjusting the typewriters. 
Henry couldn’t get the margins adjusted. The bell kept 
ringing as he moved the carriage back and forth. 

Miss Simpson, above the noise, snapped the clock and said, 
"Start." 

About half the class started.' 
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Criterion VII - - Classro om Discourse Charac t eri zed by Reas oning or Creative 

Thinking vs. Classr oom Disc ou rse Characterized by Simple 
Recall 



Rating of 1--High 

The student teacher began his English class on communication 
by citing two books on communication which were of significance: 
Understand ing Med ia and Human Use of Human Be ings . He then 
briefly reviewed the elements of communication and the methods 
by which humans communicate. 

The student teacher introduced the day’s lesson by indicating 
that communication had two purposes: (1) to make people 

feel as you do, and (2) to get information. He then indicated 
that there are several ways of getting people to feel as you do: 

1. Argument - -When I say, ’I like Kennedy; I think he should 

be President,’ I am saying I think you should think 
so too.” 

2. Comm and- -”lf I ask you to open the window because it is hot 

in here, I say I think it is hot in here and you 
should too." 

3. Observation -- "When I say, ’it is a nice day outside,’ I am 

saying I think it is a nice day outside and you 
should too.' 1 

He continued by outlining steps to follow in getting people to 
see things ”our way." After this, he indicated how information 
is acquired by inductive and deductive processes. 



The student teacher was observed in a twelfth-grade government 
class. The unit topic being studied by the class was "Individual 
Rights of American Citizens" and the specific topic under 
discussion was "Free Speech." The student teacher used a 
commercial recording which presented a simulated problem in 
this area. The problem was concerned with the "rights" involved 
if two newspapermen, using evidence based upon wiretapping 
and other means, were to print a story alleging graft on the 
part of a city alderman. The problem was open-ended. He asked 
each pupil to decide whether the story should be printed. 

Many pupils responded to the problem and a lively discussion 
ensued between those in favor of and those opposed to the 
printing of the story. During tn_ discussion the role of the 
student teacher became mainly that of a moderator. Occasionally, 
he would have to re- focus the discussion upon the problem, but 
he did not attempt to instill his ideas upon the class. Rather, 
he allowed each individual pupil to study the facts and arrive 
at his own answer. 
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The student teacher was using the inductive method to develop 
the principle that individual freedom can be enhanced through 
social planning. In his government class, he asked the students 
to list things which students could do in 1900. The students 
listed such things as hikes in the woods, hunting, fishing, 
absence of high school, etc. Students then listed activities 
possible to them now. Mentioned were automobile driving, 
college, electric lights, telephones, plumbing, etc. The 
disadvantages of high taxes, congested facilities, curfews, 
etc., were compared with the disadvantages of few social facili- 
ties The student teacher faced the students with the pro- 
position that freedom is best defined as the power to do the 
greatest number of things. This was contrasted with the 
definition of freedom as absence of social restraint. The 
student teacher did not insist that the students take either 
position, at the moment, bvt that they consider which position 

they would choose later. 



Rating of 4- “Midpoint 

The use of records of folk songs and ballads from the Uprising 
of 1645 was found in an English literature class. 



"Mercenary soldiers would have what kind of emotional reactions 
that would differ from soldiers in the regular army? quizzed 
Miss Thornberry. Then, "What kinds of feelings and emotions 
would you have if we were in a revolution today? 



Immediately, the responses grew more irresponsible with e; “h 
student trying to outdo the last. The student teacher lost control 
of the class in the laughing and noise of the students as they 
heckled each other. 



Student teacher: "What did the convict say that might frighten 

Pip?" 

Student: "That he had a young man there who would eat 

out his heart and liver if he did not do what 
he said." (Class laughter) 

Student teacher: "I know this sounds funny to you, but it 

be very frightening to a small child. What do 
we have now which we sometimes tell children 
to frighten them?" 



Student: 



"That the boogey man will get them." 
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Student teacher: "Right. And what did the convict demand of Pip?" 
Student: "Some food and a file." 

The class continued in this manner for about thirty minutes 
with the student teacher generally asking specific-recall 
questions, but occasionally asking a question which called 
for reasoning or expression of opinion. 



The student teacher in Latin II class took most of the hour 
to hear the exercises which students had worked out previously. 
Following this, the students translated exercises from Latin 
to English and vice versa. In the translation exercises, 
the student teacher asked for alternative solutions and also 
posed the question, "If it had been this, what would it have 
meant?" 



Rating of 7- -Low 

The student teacher in home economics, family living class, 
began the period with a buzz session which dealt with the 
problems of in-laws. After the buzz session, the class 
continued to give opinions and prejudices about in-laws. 

The student added some experiences of her own to illustrate 
that mothers- in- law try to dominate the family of their 
children. The student teacher then read a number of derogatory 
jokes and poems about mothers- in-law. After the period, she 
explained that her only purpose was to "talk over" the problems 
of in-laws. 



Student teacher was observed in a United States history class. 

The Revolutionary War was the topic being studied. All 
questions asked by the student teacher during the period were 
similar to the following examples. "Who wrote 'Common- 
sense'?" "Who made the motion in the Second Continental 
Congress that the colonies declare their independence?" "Who 
made a famous midnight ride?" "What was the date of the Townsend 
Act?" "What was another name for the Tories?" "What river did 
Washington cross?" 
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A tenth-grade English grammar class was discussing 
participles. The teacher passed out duplicated practice 
sentences. Betty asked, "May we make up our own 
sentences?" The teacher commented, "No, you can't do it 
that way-- Just fill in the blanks." Sentences irrelevant 
to the students' experiences were filled in with participles. 



Criterion VIII--Directs Attention to Process of Thinking vs. Fails to 

Call Attention to Process of Thinking 



Rating of 1--High 

The student teacher asked the student to define a testimonial. 
After this was done, the following dialogue ensued. 



Student teacher: "Can we rely on testimonials? I saw a 

commercial the other day featuring Andy 
Granatelli saying it was as difficult 
for him to get into a suit as it is to 
get into a racing car. So he found that 
he could rely on suits . Is that a 

reliable testimony?" 

Student: "Don't they use famous people for commercials 

all the time?" 

Student Teacher: "Yes, but is it reliable? Who is on the 

AAMCO Transmission commercial?" 



Student: "Zsa Zsa Gabor." 

Student teacher: "Is she an authority on transmissions?" 



Student: 



"Not likely." 



Student teacher: 



Student: 



"Why is she probably not an authority? Why 
would she give a testimonial?" 

"She doesn't know anything about transmissions. 
They asked her to do it because she is famous." 



Student teacher: "What kinds of testimonials can be trusted?" 



The dialogue continued in this manner for some time. 
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In a world history class, the student teacher is searching 
for defensible generalizations to conclude a unit on 
Charlemagne. His questions were, "What can we say about 
Charlemagne's ascension to power?" The students noted such 
things as consolidating individual tribes into larger 
political units, preventing subdivision, strong sense of 
purpose. The student teacher then asked if these observations 
could apply to other rulers in such a way that a general 
principle could be formulated. The student teacher asked 
several times, "How valid would it be for us to state this 
as a principle?" At one point, he asked, "Can we say that it 
is a good policy to fight wars on several fronts simultaneously?" 
He ended the period with the statement that they would spend 
the next day trying to extract principles. His assignment was 
that they should consider the consequences of a domain based 
upon a strong personality which had been ruthlessly aggressive 
in pushing its objectives. 



Student teacher was observed in a United States history class 
and the Reconstruction Era was being discussed. One part of 
the class period was devoted to a pupil debate--Resolved: 

That Congress had no right to impeach President Andrew Jackson. 
Following the debate, the student teacher summarized the 
arguments of the two sides, pointing out a faulty assumption 
on the part of one team and asking for evidence to support one 
statement made by the opposing team. 



Rating of 4--Midpoint 

A senior class in bookkeeping was involved in posting. The class 
was both presentation and laboratory. Each student was working 
on his own set. Miss Reynolds used the opaque projector for 
the ledger sheets. She asked, 

"How do you get this closing entry?" 

"To close it, what do we do?" 

"Where do you want to begin this procedure?" 

"Think about it for a moment." 

"Do you see the difference?" 

"Do you see what she did? Can you post it that way?" 



Then as the teacher worked with individuals there was constant 
attention to the proper steps for the right answer. To one 
student she said pleasantly, "That was in the last chapter. 

Do you just learn the principles for one chapter then forget 
them? Use what you learned.'" "Prove it."' 



A class in economics was discussing supply and demand. A 
pupil commented that the prices always go up on new cars. 
The student teacher asked about prices on used cars. One 
boy said used convertibles cost more in the spring than 
in the fall. The class discussed why for a few minutes, 
then went back to the text. Nothing more was said about 
new cars . 



"Did you outline your steps of procedure before you 
began?" 

"I think I understand what it is you are having a prob 
lem with, but can you see that it will not affect the 
solution?" 



Rating of 7 --Low 

Student teacher was observed in a United States history 
class. During a discussion of the consolidation of 
capital and labor the student teacher asked the follow- 
ing questions: "Does collective bargaining help the 

laboring men and not hurt the capitalists?" "Should 
our government have a right to compel capitalists and 
laborers to settle their difficulties by arbitration?" 
"How do strikes and boycotts affect the general public?" 
"Are trusts necessarily bad just because they are big?" 
"How may the laboring men win a strike?" After each 
question was asked, it was responded to orally by a 
class member. None of the pupil answers were commented 
on by the student teacher except by some expression of 
acknowledgement such as "O.K." or "All right." He would 
then proceed to another question. Students did not have 
any clear idea of what capitalists or laborers were. No 
terms were illustrated. 
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The student teacher in senior English class was leading a 
discussion of Chekhov's writings when a student burst out that 
he did not like his writing. "How do people decide who is 
great?" he asked. "Why is everyone so sure that Shakespeare 
is good?" The student teacher missed the chance to examine 
how opinions of classics are formed. He simply advised the 
student that since the textbook treated the works as important, 
the student should share the opinion. Throughout the remainder 
of the lesson, the student teacher accepted the textbook as the 
authority. 



The following discussion occurred at the beginning of a 
government class: 

Student teacher: "How many heard about the city council's 

passing a $500 raise for police and 
firemen? They sent it to the mayor and 
he vetoed it. Now they are trying to 
compromise. Last night they passed a 
resolution calling for a $200 raise. How 
many of you think our city policemen and 
firemen need a raise?" (Show of hands) 
"How many opposed?" (Show of hands) 

Student: "I don't think they need no raise. All 

they do is set around in restaurants and 
drink coffee all the time." 



Second student: "I don't think so. One night I was stopped 

by one and he told me I was speed in ' . I was 
only doin' 30. He had another friend in the 
car and they was hittin' the bottle, so I 
don't think they need a raise." 

Third student: "Firemen need a raise before the police do." 



Student teacher: "How many of you would be in favor of a $500 

raise?" (Show of hands) 

"$200" (Show of hands) 

"We will see what happens." 



The student teacher ignored cases of loose reasoning and 
resorted to a show of hands to determine a course of action. 
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564 


1.000 


.2438 


.237 3 


.767/ 


.8261 


•4oo9 




-.2767 


t2I38 


.31/7 


.3008 


.303 8 


70553 


70512 


70380 


• 0324 


-07?* 


.0681 


.0086 


-.0096 


-.2219 


-./466 


564 


564 


564 


564 


564 


564 


1.000 


.6450 


,2677 


.2184 


.9/5/ 


.233/ 


-.0026 


7 1058 


.0302 


.0350 


.nas 


70346 


.0268 


7 0/03 


.0/97 


■ 0711 


.0255 


.0407 


-.1000 


-113b 


-.0559 


564 


564 


564 


564 


564 


564 


564 


1.000 


.2522 


.2*28 


.8903 


.1768 


-.006/ 


7/056 


.08/7 


.0433 


.0536 


.0211 


.0019 


70305 


-0076 


.0266 


.1494 


7/004 


-.0*23 


-.0223 


70385 


564 


564 


564 


564 


564 


564 


564 


56 4 


1.000 


.8180 


.4852 


.587* 


-.22// 


7185/ 


.37/6 


.370* 




rO/18 


:0770 


70863 


.0675 


.mo 


-.0022 


.0135 


-.0041 


7246/ 


1/326 


384 


384 


384 


364 


364 


304 


384 


304 


384 


/.ooo 


•1477 


.3481 


.11/5 


.1309 


.3533 


.3/16 


.3169 


.0660 


.07/2 


.0462 


*07/7 


-.1046 


7 OUO 8 


-.OO77 


.0006 


•2805 


.0976 


384 


384 


384 


384 


38V- 


38¥ 


384 


384 


384 


385 


1.000 


.140/ 


-.1235 


72200 


73060 


.0794 


.1606 


-079/ 


70237 


7 1204 


“0250 


.15 18 


.08*0 


.0187 


.0 103 


-.3387 


-.2722 


384 


384 


384 


384 


384 


384 


384 


384 


384 


385 


385 


1.000 


-./9 58 


70176 


.4848 


.3121 


.3701 


t0025 


.0167 


MSS 


.03r/ 


.0828 


70606 


-.003/ 


.0287 


-.1009 


.0010 


534 


539 


539 


539 


5 31 


539 


S3 9 


539 


539 


367 


365 


365 


/.ooo 


.5935 


75738 


73670 


-.1865 


.3480 


.3504 


.299/ 


-.0030 


.0236 


70382 


-.0602 


.0262 


.1220 


”0611 


309 


301 


309 


309 


309 


30? 


301 


309 


309 


266 


266 


266 


295 


/.ooo 


— 


72614 


-.1335 


.3453 


.5366 


.5116 


“.02a 


.00*/ 


70636 


-.0570 


.0290 


.1394 


.1286 


52 


52 


52 


52 


52 


52 


52 


52 


52 


35 


35 


35 


51 


0 


1.000 


.3766 


.3321 


— 


7/44/ 


.0/00 


.26?8 


./??/ 


7287* 


.000/ 


-.01/4 


.0067 


.//9/ 


431 


431 


431 


431 


431 


431 


431 


43/ 


431 


210 


290 


290 


4/6 


235 


52 


1.000 


.3490 


70849 


7/688 


70660 


.0073 


-.0270 


.0325 


.0169 


70566 


-.0758 


-.0468 


534 


534 


534 


534 


534 


534 


534 


534 


534 


367 


367 


367 


5/0 


212 


52 


426 


1.000 


7/072 


70437 


-.0074 


-,0217 


.00*3 


.0090 


.0384 


-.0266 


-.1024 


-.0010 


377 


377 


377 


377 


377 


377 


377 


377 


377 


266 


266 


266 


35? 


264 


0 


<173 


358 


1.000 


.1750 


.1897 


70935 


70516 


.0886 


7 0057 


70*25 


.0704 


.0895 


337 


337 


337 


337 


337 


337 


337 


337 


337 


237 


237 


237 


320 


303 


35 


263 


320 


2*2 


1.000 


.6873 


t/70* 


.0156 


.0311 


:27*2 


.3228 


70161 


.073* 


337 


337 


337 


337 


337 


3 37 


337 


337 


337 


237 


237 


237 


320 


303 


35 


263 


320 


2*2 


337 


(.000 


7/09/ 


.0298 


.0623 


7/86 1 


.22(6 


.0267 


.0*73 


VV5 


445 


445 


445 




445 


445 


445 


445 


3(6 


316 


3/6 


*26 


253 


36 


333 


*23 


3/6 


2 67 


267 


I.000 


'.1539 


7114* 


.0/46 


-.0767 


-.0579 


1//2I 


445 


445 


445 


H*S 


446 


445 


445 


445 


445 


31 (o 


3/6 


3/6 


426 


W3 


36 


333 


*23 


3/6 


267 


267 


**5 


/.ooo 


t24II 


-.3789 


7/868 


-.246/ 


-•0957 


445 


445 


445 


445 


445 


445 


445 


445 


445 


316 


3/6 


3/6 


426 


253 


36 


333 


*23 


3/6 


267 


267 


**5 


4*5 


1.000 


-.3572 


-./58S 


.057/ 


-.050/ 


445 


445 


445 


445 


4-45 


445 


445 


445 


445 


316 


3/6 


3/6 


426 


Z53 


36 


333 


*23 


3/6 


267 


267 


445 


**5 


445 


j.000 


-.2977 


-.2/46 


-.06/2 


445 


445 


445 


445 


H4S 


445 


495 


445 


445 


316 


3/6 


31 6 


426 


253 


36 


333 


*23 


3/6 


267 


267 


445 


*45 


44? 


445 


1.000 


-.0929 


-.0893 


*45 


445 


445 


445 


445 


445 


445 


445 


445 


3lb 


3/6 


3/6 


^26 


253 


36 


333 


423 


3/6 


267 


267 


**5 


445 


*45 


**5 


445 


/.OOO 


.1500 


445 


445 


ms 


445 


H45 


445 


445 


445 


445 


316 


3/6 


3/6 


426 


253 


36 


333 


*23 


316 


267 


267 


445 


445 


4*5 


445 


**5 


*M5 


1.000 


m 


426 


426 


426 


426 


426 


426 


426 


426 


299 


297 


279 


407 


2 99 


0 


308 


401 


*11 






42 4 


424 


424 


424 


424 


424 


*2* 


41b 


426 


4?6 


426 


426 


426 


426 


426 


426 


299 


299 


299 


907 


299 


0 


308 


*0/ 


419 






424 


424 


424 


424 


424 


424 


424 


4li> 


426 


426 


426 


426 


426 


426 


426 


426 


299 


299 


299 


4o 7 


299 


0 


308 


4oi 


41? 






424 


424 


424 


424 


424 


_!&4 


424 


V26 


47, f 


426 


426 


426 


426 


426 


426 


426 


299 


299 


299 


407 


299 


0 


30 8 


*01 


*11 






424 


424 


424 


424 


424 


424 


42 4 


4 26 


<{26 


*{26 


426 


426 


426 


426 


426 


426 


299 


299 


299 


40 7 


299 


0 


308 


401 


*11 






*2* 


424 


424 


*2* 


*2* 


*2* 


924 


426 


426 


426 


4?6 


426 


426 


426 


426 


426 


299 


299 


299 


407 


299 


0 


308 


401 


491 






424 


424 


424 


424 


424 


424 


424 


426 


426 


426 


426 


426 


426 


426 


426 


426 


a.79 


299 


299 


407 


299 


0 


308 


401 


499 






429 


424 


42*{ 


V24 


424 


424 


424 


426 


426 


426 


426 


m 


426 


426 


426 


426 


211 


21? 


29«| 


*07 


299 


0 


308 


401 


499 






424 


_ML 


_ii2t 


424 


424 


424 


4-24 


426 


426 


426 


426 


416 


426 


426 


426 


426 


219 


211 


299 


*07 


299 


0 


308 


401 


499 






_42f{ 




_424 


424 


424 


424 


424 


426 


426 


426 


426 


426 


426 


426 


426 


426 


299 


211 


219 


407 


299 


0 


308 


40 f 


499 






424 


424 


4-24 


424 


424 


424 


424 


426 


426 


426 


426 


4 26 


426 


426 


42 6 


426 


211 


211 


299 


*07 


299 


0 


308 


401 


491 






42 4 


424 


424 


424 


424 


424 


424 


4Z6 


426 


426 


426 


426 


426 


426 


42b 


*26 


29? 


211 


291 


407 


299 


0 


308 


401 


419 






424 


424 


424 


424 


424 


424 


424 


426 


426 


426 


426 


426 


426 


426 


426 


426 


219 


299 


299 


*07 


299 


0 


308 


*01 


*11 






_MJ 


42 4 


424 


424 


_424 


424 


424 


426 


426 


426 


426 


426 


42b 


426 


426 


426 


291 


299 


299 


*07 


299 


0 


308 


401 


499 






424 


_424 


424 


424 


424 




424 


42 6 


426 


426 


426 


426 


426 


426 


426 


426 


291 


299 


299 


*07 


299 


0 


308 


401 


499 






424 


_424 


_424 


424 


424 


424 


424 


42 6 


426 


426 


426 


42 6 


426 


426 


4 26 


426 


299 


219 


299 


407 


299 


0 


308 


40/ 


*11 






424 




424 


424 


424 


424 


421 


426 


426 


426 


42 6 


426 


426 


426 


426 


426 


299 


299 


299 


*07 


299 


0 


308 


401 


499 






424 


424 


424 


424 


424 


424 


424 


426 


426 


426 


426 


426 


426 


426 


426 


126 


299 


219 


291 


407 


299 


0 


308 


*0/ 


499 






_424 


4z4 


424 


424 


421 


424 


_424 


424 


424 


424 


424 


42.4 


424 


424 


424 


424 


298 


298 


2?fl 
































424 


424 


424 


424 


414 


424 


424 


424 


424 


298 


290 


216 
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ABCE F GHI L M N 0 Q. Qe Qa Q 4 ANX.EXTR. m & lt SC ore 



-0230 


:OC28 


-.0470 


TOI27 


-.0390 


-.0421 


-.0894 


*Cj 4 6 


.042c 


:0C<n 


.0fe56 


.0051 


70/681.027/ 


71114 


.0573 


.019 3 


70680 


.2 144 


1/3 


.0323 


:on<? 


-./564 


70138 


.0000 


-Jfe/7 


-.0820 


.0441 


.0116 


.0500 


:o3Si 


.1140 


70624 


70/59 


7/141 


.1376 


•1735 


70342 


.2254 


1.20 


■0425 


.007/ 


-1608 


7/705 


-.0133 


-082V 


-.2368 


-0/87 


.0300 


70481 


.oho 


.0568 


-O^i 


.0260 


“07/5 


.0784 


.1439 


r/829 


.3/43 


2.46 


.0301 


.0067 


'./444 


7/677 


-.100 7 


:/5*g 


-.2113 


.1049 


.0050 


.0160 


70017 


.1541 


70412 


.0412 


70834 


.0685 


A663 


r/900 


.33/5 


2.78 


■041$ 


-0264 


:/395 


-.0642 


70412 


7/603 


-.125/ 


.0059 


.0497 


.0/65 


.0396 


.1061 


70746 


.0366 


7097/ 


.116 6 


.1515 


70922 


.26/2 


1.64 


-.02 7* 


-.0462 


-,/6fcl 


-.17 31 


7064/ 


7/097 


-.1920 


-.0240 


.044/ 


.0/87 


.0331 


.0954 


:0398 


.0390 


7// 22 


.0781 


./64V 


r/769 


.2983 


2.20 


.130b 


.0233 


.0027 


.0325 


.loss 


70535 


.0182 


'.0273 


.0587 


70426 


.0305 


.0/68 


7O8C/ 


70835 


70064 


.0382 


.0/75 


.1117 


.2178 


/• IE 


ms 


.0655 


.0107 


.0405 


.1377, 


-.137/ 


.0828 


"0579 


.0662 


70522 


.0904 


.0/63 


70221 


-0332 


70612 


.0621 


.0278 


. / /07 


.2860 


2.00 


'Mb 3 


-.0402 


-.I45O 


70858 


-,046V 


7/322 


-.1501 


.0382 


.0459 


.0/26 


■0//8 


.1119 


707V3 


.0222 


-Aim 


.1359 


.1700 


7/082 


.2620 


1.66 


.0139 


.0229 


.13 66 


mo 


.0898 


.0886 


.2279 


.00 10 


70581 


.0067 


.0/28 


70469 


.0567 


:0*/7 


.mz 


70973 


7/65? 


./?48 


.2953 


1.48 


./72V 


.0239 


70898 


-.0557 


.05/4 


70997 


•0452 


70535 


.0/11 


.0698 


.0972 


.0/46 


70627 


7/086 


-0064 


.0444 


.0344 


.0611 


.3/53 


1-71 


.0581 


:0337 


7045S 


.03/0 


.0389 


-.1279 


.0242 


.0806 


.0502 


.0979 


70244 


.0794 


70943 


7 0033 


7/255 


.0766 


.0774 


.0402 


.240/ 


0.94 


•.0481 


.285^ 


.0615 


.1/7/ 


’.0145 


.0482 


-.0326 


.OfelO 


70/61 


.1/2/ 


.0267 


-.0637 


.0491 


mi 


.0423 


7 0/46 


70336 


rO/74 






-0417 


.2092 


•1138 


./680 


70485 


-.0726 


-.0112 


.0426 


.0388 


.1210 


.0381 


70234 


.1379 


.1131 


70750 


70097 


70344 


.0082 














































.0344 


70800 


70452 


7/288 


70807 


-.0544 


-.1114 


•0043 


-.0372 


70/86 


.0032 


.0207 


70542 


70793 


7O8I6 


.0801 


.0896 


.0993 






.0fe¥6 


-.0471 


70452 


-.0257 


.0064 


-.1215 


-.0619 


.0387 


70339 


70240 


7060/ 


.0300 


70264 


70614 


70283 


.0 569 


.0635 


-0(85 






tO/99 


.2447 


.0303 


.0418 


70863 


-.0151 


7/290 


.097/ 


70403 


.097/ 


♦0563 


:0W 


.0782 


.1556 


r0932 


70568 


70193 


7/041 






















































































-.0645 


.0V29 


-.0504 


70305 


-.0331 


-ons 


70438 


70/63 


.0753 


70699 


71233 


.0406 


70421 


70082 


70061 


.015/ 


.0496 


:0387 






mo 


.0783 


.0644 


700/8 


• 1/79 


.0796 


•0772 


'.0054 


*:0fe7? 


-0293 


.0466 


70768 


.0056 


70097 


.0562 


7(W77 


;B077 


.09/6 






-OgJif 


-0206 


-.0558 


'0036 


70376 


707/4 


-.0/48 


.0/84 


707/9 


70109 


.0469 


70513 


.0027 


.0458 


.0033 


70/59 


7 02 04 


-M93 






.0642 


•044.3 


-.0081 


.00$9 


.0648 


.0007 


70077 


.0347 


.064? 


-.0055 


7/675 


.6608 


-OSS'? 


7/0/3 


.0/27 


.0764 


.0622 


.050? 






.0230 


-007/ 


-.0608 


-.0475 


70463 


-.0/24 


-.0267 


.0223 


70082 


70022 


.0348 


.0236 


.0021 


.1029 


.0659 


-0645 


70/32 


70546 






47046 


70020 


.0554 


.0034 


-.0304 


./064 


.0279 


• 0622 


70458 


705/0 


.0800 


70681 


.0/37 


-.0080 


.0260 


-.0797 


70896 


.0009 






.^//? 


-.0387 


.0684 


.0462 


-.0386 


10059 


70104 


.0523 


-.043/ 


70151 


70798 


70276 


70952 


.0761 


70008 


7 0461 


70396 


:0/ 65 






4000 


.0124 


.0506 


.0804 


.3330 


.0446 


.3/52 


./655 


-.0887 


7 0094 


■ 021b 


.0231 


70/43 


■3117 


.0149 


70818 


7/145 


.4634 






fc/7 


1.000 


.0027 


.0428 


10234 


10328 


.0203 


.0539 


.00/8 


.0693 


.01 bO 


70962 


.0888 


.0557 


70131 


70555 


70636 


.0279 






loll 


6/7 


1.000 


./Oil 


.158 8 


.3195 


.3118 


7/306 


7346/ 


71555 


.21 86 


74499 


.0566 


70824 


.2757 


-.5377 


76960 


.2408 






6/7 


6/7 


6/7 


1.000 


.3806 


-mi 


.3989 




• 1428 


.0694 


70486 


•00/8 


J/75 


-.0876 


72172 


.1220 


.0/11 


.6365 






6/ 7 


6/7 


6/7 


617 


1.000 


-.0346 


.4787 


70952 


.0880 


71678 


.0242 


70136 


.0291 


74080 


-.1088 


.02 43 


7 0776 


.803/ 






(oil 


6/7 


617 


loll 


617 


1000 


•1235 


7/496 


-27/0 


.1894 


.1869 


-2102 


70964 


-.1610 


.3606 


r302l 


73816 


.0264 






LI7 


6/7 


617 


6/7 


617 


6/7 


(.000 


*.0281 


7/437 


70458 


.0677 


7/585 


.0611 


-.3146 


.mi 


72265 


74247 


.8183 






fe/7 


617 


fell 


6 / 1 


(&I7 


617 


6/7 


1.000 


.0/50 


.2254 


704/3 


.0784 


.0049 


.1603 


:027l 


.1033 


.1090 


70550 






k 17 


6/7 


6l 7 


611 


617 


6)7 


6/7 


611 


1.000 


./698 


7/538 


.390/ 


-.0217 


.0211 


73527 


.4522 


.6359 


7006? 






_iil 


617 


617 


617 


617 


fen 


617 


fen 


617 


1.000 


-.0450 


.136/ 


.1082 


.2465 


70750 


.1737 


.1825 


7IO8? 






6/7 


6/7 


617 


611 


611 


617 


6/7 


tii 


617 


611 


/.OO0 


-2327 


.0113 


70483 


.2282 


72266 


72833 


.0378 






617 


617 


617 


611 


611 


6/7 


617 


tn 


fe 1 7 


611 


6/7 


1.000 


7090? 


.0/22 


72993 


.5286 


.7463 


70732 






617 


617 


617 


6/1 


617 


617 


617 


6/1 


6/7 


617 


6/7 


617 


(.000 


.0962 


7 0118 


70499 


70650 


.054/ 






6/7 


617 


6/7 


6/7 


6/7 


617 


617 


611 


6/7 


fel 7 


6/7 


6/7 


617 


1.000 


70487 


.0520 


-f/10 


7 505? 






_60 


fell 


fen 


6/1 


6/7 


fen 


6/7 


611 


617 


tn 


617 


fe/7 


6/7 


61 7 


1.0000 


73715 


75669 


7039? 






617 


6/7 


6/7 


611 


617 


617 


6/7 


6/7 


6/1 


6n 


tail 


6/7 


fen 


611 


6/7 


1.000 


.8327 


7068 3 






617 


617 


617 


6/7 


(cl 7 


617 


6/7 


6/7 


611 


6(7 


6/7 


6/7 


6/7 


6/7 


6/7 


617 


1.000 


7 24/5 






6/7 


617 


fen 


6/7 


6/7 


61/ 


fe/7 


6l7 


6/1 


6/7 


617 


617 


617 


617 


6/7 


617 


6/7 


1.000 























































































I 

II 

III 
IY 

V 

YI 

YII 

YIII 

IX 

X 

XI 

XII 
CUM. GPA 
EST. GPA 
EST. X 
EST. Y 
EST. Z 
CORNELL TEST 
SAT VERBAL 
SAT MATH 
MN 

ML 

P 

R 

D 

LT 

TP 

A 

B 

C 

E 

F 

G 

H 

I 

L 

M 

N 

0 

Q, 

Qa 

Qj 

0 # 

ANX. 

EXTR. 

MULT. R 
F-SCORE 



5 

5 

T 

P 

P 



T 

C 

A 

P 



1 

6 

P. 

F. 
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